00000001:02000400:2.0F:1788748127.085565:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_hostid 00000001:02000400:2.0:1788748143.089257:0:3183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788748145.253536:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 559 MB/s 00000001:01000000:2.0:1788748145.503970:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 555 MB/s 00000001:01000000:1.0F:1788748145.753095:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9075 MB/s 00000020:02000000:0.0F:1788748146.694957:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g2290de3 00000400:02000000:0.0:1788748147.711878:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.104@tcp [8/256/0/180] 00008000:02000000:0.0:1788748153.241888:0:3439:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788748207.638285:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788748218.343609:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748218.343615:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788748218.343755:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000988ae846 00000080:02000400:2.0:1788748218.343765:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788748218.352603:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788748218.352618:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788748218.352853:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009a22cdf7) 00000020:00000080:3.0:1788748218.352873:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788748218.392559:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788748218.393567:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788748218.463809:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788748218.463849:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788748218.463870:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788748218.463921:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788748218.463948:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788748218.465387:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788748218.465397:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748218.465407:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bc32 00000020:01000004:2.0:1788748218.465415:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788748218.465420:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788748218.465425:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000988ae846 from MGS 00000020:01000004:2.0:1788748218.465430:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788748218.465449:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a958c5b) 00000020:00000080:2.0:1788748218.465460:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788748218.465541:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000988ae846 from MGS, refs=2 00080000:01000000:2.0:1788748218.465547:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788748218.465623:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bc40 00000100:00100000:2.0:1788748218.465776:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788748218.465911:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788748218.465917:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788748218.467541:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788748218.467564:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788748218.468401:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748218.468587:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788748218.468593:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788748218.469492:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788748218.469501:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788748218.470520:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788748218.470807:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788748218.476719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748218.476725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748218.476727:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748218.478163:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748218.478167:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748218.478169:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748218.483136:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788748218.492335:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788748218.728244:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4995 MB/s 00000001:01000000:3.0:1788748218.978419:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6583 MB/s 00000001:01000000:0.0:1788748219.228053:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 987 MB/s 00000001:01000000:1.0:1788748219.478109:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1539 MB/s 00080000:10000000:2.0:1788748219.483542:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788748219.492787:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788748219.492804:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788748219.492807:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788748219.494384:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788748219.495495:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788748219.495544:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788748219.495760:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788748219.495786:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788748219.496340:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748219.496554:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788748219.496560:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788748219.498102:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788748219.498115:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788748219.500831:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788748219.500844:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:2.0:1788748219.501381:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788748219.501663:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788748219.501682:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:0.0:1788748219.501684:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1788748219.502002:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788748219.502161:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:1.0:1788748219.502189:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (00000000d49efd13) 00000020:00000080:1.0:1788748219.502205:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788748219.502332:0:5825:0:(ldlm_lib.c:103:import_set_conn()) imp 000000007be1344f@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788748219.502661:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:1.0:1788748219.502668:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788748219.503663:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788748219.503763:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid e30aac72-4ae1-4e90-ba43-18115a48a5f4) 00000020:00000080:1.0:1788748219.503782:0:5825:0:(genops.c:1384:class_connect()) connect: client e30aac72-4ae1-4e90-ba43-18115a48a5f4, cookie 0x5b377f42a7a7bc4e 00000100:00080000:1.0:1788748219.503792:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748219.503799:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import 000000007be1344f using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748219.503844:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000d88253e x1875638376988800/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748219.503940:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d88253e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638376988800:0@lo:250: 00000100:00100000:1.0:1788748219.504033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748219.504092:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS 00000020:01000004:1.0:1788748219.504110:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788748219.504115:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788748219.504125:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a3f0346) 00000020:00000080:1.0:1788748219.504135:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788748219.507516:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376988800 00000100:00100000:2.0:1788748219.507533:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376988800 00000100:00100000:2.0:1788748219.507571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748219.507578:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000077b544c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875638376988800:12345-0@lo:250: 00010000:00080000:2.0:1788748219.507608:0:5836:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from e30aac72-4ae1-4e90-ba43-18115a48a5f4@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:2.0:1788748219.507635:0:5836:0:(genops.c:1384:class_connect()) connect: client e30aac72-4ae1-4e90-ba43-18115a48a5f4, cookie 0x5b377f42a7a7bc5c 00000100:00080000:2.0:1788748219.507788:0:5836:0:(import.c:65:import_set_state_nolock()) 000000000788a6a9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748219.507889:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000077b544c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:3305:x1875638376988800:12345-0@lo:250: Request processed in 310us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748219.507897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748219.508540:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788748219.508550:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1788748219.508558:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788748219.508562:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788748219.508565:0:3305:0:(import.c:65:import_set_state_nolock()) 000000007be1344f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788748219.508568:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788748219.508571:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788748219.508575:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d88253e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638376988800:0@lo:250: 00000100:00100000:1.0:1788748219.516831:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748219.517043:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788748219.517050:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788748219.521397:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788748219.521410:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788748219.521937:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788748219.521946:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788748219.522587:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748219.522779:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788748219.522786:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788748219.523379:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788748219.523386:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788748219.565944:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748219.566546:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788748219.566553:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788748219.568143:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788748219.568158:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788748219.569089:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748219.569363:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788748219.569504:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788748219.570959:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788748219.570970:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788748219.571940:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748219.572174:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788748219.572194:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788748219.573103:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748219.573112:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788748219.573707:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748219.573878:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788748219.573883:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788748219.576861:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788748219.576878:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788748219.609996:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748219.610787:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788748219.610795:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788748219.616902:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788748219.616931:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788748219.620998:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748219.621041:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788748219.625415:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788748219.625442:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788748219.625448:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788748219.625589:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788748219.625622:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788748219.625627:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788748219.625628:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788748219.625630:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748219.625631:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748219.625633:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748219.625634:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748219.625635:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748219.625637:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788748219.625638:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748219.625639:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748219.625641:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748219.625642:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748219.625645:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788748219.625647:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748219.625648:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788748219.625649:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748219.625650:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748219.625651:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748219.625652:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748219.625653:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748219.625654:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788748219.625659:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748219.625660:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748219.625661:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748219.625662:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748219.625692:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788748219.625709:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d04997ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376988928:0@lo:253: 00000100:00100000:2.0:1788748219.625772:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748219.625820:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6f12b17 going to sleep for 11 seconds 00000100:00100000:1.0:1788748219.626215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376988928 00000100:00100000:1.0:1788748219.626224:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376988928 00000100:00100000:1.0:1788748219.626269:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748219.626277:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082e837f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5825:x1875638376988928:12345-0@lo:253: 20000000:01000000:1.0:1788748219.626320:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788748219.626324:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788748219.626712:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788748219.626765:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788748219.627126:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748219.629374:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788748219.629783:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788748219.629788:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788748219.629793:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788748219.629796:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788748219.629812:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788748219.630063:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748219.630754:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788748219.630769:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788748219.630817:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788748219.630870:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788748219.630908:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788748219.631068:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788748219.631092:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788748219.631153:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788748219.631162:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788748219.631205:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788748219.631213:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788748219.631245:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788748219.631295:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788748219.631326:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788748219.631332:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788748219.631347:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748219.631561:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788748219.631571:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788748219.631606:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788748219.631641:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788748219.631687:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788748219.631699:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788748219.631771:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788748219.631780:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788748219.631824:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788748219.631863:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788748219.631900:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788748219.631911:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788748219.631994:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788748219.632002:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788748219.632082:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788748219.632120:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788748219.632308:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788748219.632360:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788748219.632367:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788748219.633367:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788748219.633706:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788748219.633732:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:1.0:1788748219.633734:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:1.0:1788748219.633770:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788748219.633778:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788748219.633808:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788748219.633815:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:1.0:1788748219.633859:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788748219.633870:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788748219.633901:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788748219.633936:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788748219.633996:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788748219.634000:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788748219.634003:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788748219.634339:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788748219.634343:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788748219.634388:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788748219.634391:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788748219.636666:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788748219.637314:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788748219.637370:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788748219.637418:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788748219.637434:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788748219.637437:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788748219.639088:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788748219.639458:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788748219.639517:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788748219.639615:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788748219.639631:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748219.639634:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788748219.639639:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788748219.639641:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788748219.639646:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788748219.639652:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788748219.647580:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788748219.647809:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788748219.658507:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788748219.658562:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788748219.658634:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788748219.658873:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788748219.658894:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658911:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658921:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658927:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658933:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658940:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658962:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e307d9e3 already unused, calling callback (00000000cec6877b) 00010000:00010000:2.0:1788748219.658975:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658984:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.658996:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.659003:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748219.659008:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e307d9e3/0x5b377f42a7a7bc63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748219.659070:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788748220.039946:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082e837f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5825:x1875638376988928:12345-0@lo:253: Request processed in 413663us (414167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748220.039961:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d04997ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376988928:0@lo:253: 00000100:00100000:3.0:1788748220.039966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:2.0:1788748220.039977:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788748220.039980:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748220.039982:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788748220.039983:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748220.039985:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788748220.039986:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748220.039987:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748220.039988:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748220.039989:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788748220.039990:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788748220.039992:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748220.039993:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748220.040009:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000988ae846 from lustre-MDT0000 10000000:01000000:2.0:1788748220.040053:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788748220.040064:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788748220.040069:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99cee507b380 10000000:01000000:2.0:1788748220.040072:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748220.040079:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cee507b380 from 1 10000000:01000000:2.0:1788748220.040082:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788748220.040116:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.040127:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.040215:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.040234:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d04997ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989056:0@lo:101: 00000100:00100000:2.0:1788748220.040270:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748220.040362:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007198181 going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.047346:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989056 00000100:00100000:1.0:1788748220.047362:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989056 00000100:00100000:1.0:1788748220.047466:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748220.047475:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008afd92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5825:x1875638376989056:12345-0@lo:101: 00010000:00010000:1.0:1788748220.047493:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748220.047513:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0ae168e/0x5b377f42a7a7bc71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bc6a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.047538:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0ae168e/0x5b377f42a7a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.047550:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0ae168e/0x5b377f42a7a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.047567:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0ae168e, rc 0) 00000100:00100000:1.0:1788748220.047643:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008afd92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:5825:x1875638376989056:12345-0@lo:101: Request processed in 169us (7372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.047658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748220.047746:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d04997ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989056:0@lo:101: 00010000:00010000:0.0:1788748220.047773:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.047782:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748220.047877:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb0e96e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989184:0@lo:501: 00000100:00100000:0.0:1788748220.047906:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.058476:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073d1dc6b going to sleep for 11 seconds 00000100:00100000:2.0:1788748220.063856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989184 00000100:00100000:2.0:1788748220.063874:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989184 00000100:00100000:2.0:1788748220.064827:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748220.064838:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000222499b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:5825:x1875638376989184:12345-0@lo:501: 00000100:00100000:2.0:1788748220.065467:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000222499b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:5825:x1875638376989184:12345-0@lo:501: Request processed in 630us (17559us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748220.065474:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748220.065577:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb0e96e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989184:0@lo:501: 10000000:01000000:0.0:1788748220.065612:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788748220.065624:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.065633:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000e307d9e3/0x5b377f42a7a7bc6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748220.065642:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cec8720800 10000000:01000000:0.0:1788748220.065657:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788748220.065662:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cec8720800 10000000:01000000:0.0:1788748220.065664:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788748220.065667:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99cec8720800 from 1 10000000:01000000:0.0:1788748220.065669:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788748220.065700:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.065716:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.065724:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748220.065741:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb0e96e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989312:0@lo:101: 00000100:00100000:0.0:1788748220.065786:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.065839:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073d1dc6b going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.065861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989312 00000100:00100000:3.0:1788748220.065869:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989312 00000100:00100000:3.0:1788748220.066226:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748220.066235:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c6b7b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:5825:x1875638376989312:12345-0@lo:101: 00010000:00010000:3.0:1788748220.066247:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748220.066261:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045208645/0x5b377f42a7a7bc7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bc78 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.066282:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045208645/0x5b377f42a7a7bc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc78 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.066293:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045208645/0x5b377f42a7a7bc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc78 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.066313:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045208645, rc 0) 00000100:00100000:3.0:1788748220.066349:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c6b7b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+7:5825:x1875638376989312:12345-0@lo:101: Request processed in 116us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.066355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748220.066431:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb0e96e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989312:0@lo:101: 00010000:00010000:2.0:1788748220.066445:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.066453:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748220.066473:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788748220.066476:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.066482:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000000200859c/0x5b377f42a7a7bc78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748220.066488:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788748220.066491:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748220.066495:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cec8720800 10000000:01000000:2.0:1788748220.066497:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788748220.066500:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788748220.066502:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788748220.066516:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.066522:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.066529:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.066541:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a60492d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989440:0@lo:101: 00000100:00100000:2.0:1788748220.066567:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748220.072959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989440 00000100:00100000:3.0:1788748220.072977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989440 00000100:00100000:2.0:1788748220.073031:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050bde740 going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.073194:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748220.073203:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048535d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+7:5825:x1875638376989440:12345-0@lo:101: 00010000:00010000:3.0:1788748220.073220:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748220.073238:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000699bf6e6/0x5b377f42a7a7bc8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bc86 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.073265:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000699bf6e6/0x5b377f42a7a7bc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.073274:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000699bf6e6/0x5b377f42a7a7bc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.073282:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000699bf6e6, rc 0) 00000100:00100000:3.0:1788748220.073350:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048535d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+8:5825:x1875638376989440:12345-0@lo:101: Request processed in 148us (6782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.073358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748220.073379:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a60492d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989440:0@lo:101: 00010000:00010000:1.0:1788748220.073399:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.073410:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748220.073474:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989568:0@lo:501: 00000100:00100000:1.0:1788748220.073518:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748220.073560:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007385f17d going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.074306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989568 00000100:00100000:3.0:1788748220.074313:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989568 00000100:00100000:3.0:1788748220.074354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748220.074360:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d829fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+8:5825:x1875638376989568:12345-0@lo:501: 00000100:00100000:3.0:1788748220.074613:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d829fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5825:x1875638376989568:12345-0@lo:501: Request processed in 253us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.074625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748220.074757:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989568:0@lo:501: 00000100:00100000:1.0:1788748220.074795:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989696:0@lo:503: 00000100:00100000:1.0:1788748220.074835:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748220.074867:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007385f17d going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.074882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989696 00000100:00100000:1.0:1788748220.074885:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989696 00000100:00100000:1.0:1788748220.074905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748220.074910:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b23e143f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5825:x1875638376989696:12345-0@lo:503: 00000100:00100000:1.0:1788748220.075086:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b23e143f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5825:x1875638376989696:12345-0@lo:503: Request processed in 175us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.075093:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748220.075123:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376989696:0@lo:503: 00000100:00100000:3.0:1788748220.077293:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004412fc87 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5867:1875638376989824:0@lo:502: 00000100:00100000:3.0:1788748220.077364:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748220.077406:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d3ee29e going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.077522:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989824 00000100:00100000:1.0:1788748220.077530:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989824 00000100:00100000:1.0:1788748220.077576:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748220.077584:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ce1d058 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5867:x1875638376989824:12345-0@lo:502: 00000100:00100000:1.0:1788748220.077893:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ce1d058 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5867:x1875638376989824:12345-0@lo:502: Request processed in 309us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.077900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748220.079251:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004412fc87 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5867:1875638376989824:0@lo:502: 00000020:01000000:2.0:1788748220.079303:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748220.079316:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748220.079326:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788748220.079332:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788748220.079335:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748220.079350:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b5d1a1eb) 00000020:00000080:2.0:1788748220.079370:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788748220.079375:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788748220.079739:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788748220.079749:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bc9b 00000020:00000080:1.0:1788748220.079988:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788748220.079993:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748220.079997:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.079998:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788748220.080005:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748220.080008:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.080009:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788748220.080115:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748220.080125:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b755809b) 00000020:00000080:1.0:1788748220.080137:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788748220.080142:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788748220.080143:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788748220.080146:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788748220.080152:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748220.080212:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000988ae846 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788748220.080223:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007cbda60a) 00000020:00000080:1.0:1788748220.080230:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788748220.081778:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788748220.081792:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7bcb0 00000020:00000080:0.0:1788748220.081915:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788748220.081922:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788748220.081926:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b377f42a7a7bcb7 00080000:01000000:0.0:1788748220.081932:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788748220.081936:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bcbe 00080000:10000000:0.0:1788748220.082397:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788748220.082596:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788748220.091883:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788748220.199698:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788748220.200139:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788748220.202203:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788748220.202492:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788748220.256947:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004c05dca7) 00000020:00000080:3.0:1788748220.256981:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788748220.257076:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788748220.257083:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bccc 00000020:00000080:2.0:1788748220.257607:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788748220.259010:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.323270:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.410321:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.475346:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.517493:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788748220.529725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788748220.548542:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788748220.583933:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b377f42a7a7bcd3 00000020:00000080:1.0:1788748220.584603:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788748220.584615:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748220.584622:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.584624:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788748220.584627:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748220.584630:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.584632:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748220.584635:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748220.584636:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748220.584639:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748220.584641:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.584744:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788748220.584750:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748220.584756:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748220.584757:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788748220.584761:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788748220.584795:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788748220.584899:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5867:1875638376989952:0@lo:502: 00000100:00100000:1.0:1788748220.585108:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748220.585207:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063023092 going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.585311:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376989952 00000100:00100000:3.0:1788748220.585319:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376989952 00000100:00100000:3.0:1788748220.585395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748220.585404:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d14219f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5867:x1875638376989952:12345-0@lo:502: 00000100:00100000:3.0:1788748220.585618:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d14219f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5867:x1875638376989952:12345-0@lo:502: Request processed in 216us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.585626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748220.585749:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c3a050f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5867:1875638376989952:0@lo:502: 00000020:01000000:0.0:1788748220.585776:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748220.585781:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748220.585782:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788748220.585785:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788748220.586084:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788748220.586103:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788748220.586118:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.586128:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000085f87443/0x5b377f42a7a7bc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748220.586134:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cec8720800 from 1 10000000:01000000:2.0:1788748220.586137:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748220.586163:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.586178:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.586186:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.586212:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990080:0@lo:101: 00000100:00100000:2.0:1788748220.586248:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748220.586459:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037efd7fe going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.586543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990080 00000100:00100000:3.0:1788748220.586548:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990080 00000100:00100000:3.0:1788748220.586581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748220.586588:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5efd4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:5825:x1875638376990080:12345-0@lo:101: 00010000:00010000:3.0:1788748220.586599:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748220.586611:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bcda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.586632:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.586652:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.586671:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094d955f4, rc 0) 00000100:00100000:3.0:1788748220.586709:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5efd4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:5825:x1875638376990080:12345-0@lo:101: Request processed in 122us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.586715:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748220.586855:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990080:0@lo:101: 00010000:00010000:2.0:1788748220.586868:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.586875:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.587561:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990208:0@lo:256: 00000100:00100000:2.0:1788748220.587604:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748220.587627:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037efd7fe going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.588041:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990208 00000100:00100000:3.0:1788748220.588047:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990208 00000100:00100000:3.0:1788748220.588075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748220.588081:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1138e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:5825:x1875638376990208:12345-0@lo:256: 20000000:01000000:3.0:1788748220.588097:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788748220.588102:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788748220.588183:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1138e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:5825:x1875638376990208:12345-0@lo:256: Request processed in 102us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.588191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748220.588307:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990208:0@lo:256: 10000000:01000000:2.0:1788748220.589011:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748220.589036:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.589046:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748220.589054:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec8720800 from 1 10000000:01000000:2.0:1788748220.589057:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748220.589084:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.589092:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.590824:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748220.591589:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990336:0@lo:101: 00000100:00100000:3.0:1788748220.591716:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748220.591786:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1aadd91 going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.591832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990336 00000100:00100000:1.0:1788748220.591839:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990336 00000100:00100000:1.0:1788748220.591929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748220.591937:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4bccb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:5825:x1875638376990336:12345-0@lo:101: 00010000:00010000:1.0:1788748220.591953:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748220.591980:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.592008:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.592045:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748220.592053:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bc72b4b, rc 0) 00000100:00100000:1.0:1788748220.592105:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4bccb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990336:12345-0@lo:101: Request processed in 170us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.592112:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748220.592212:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000687aaede pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990336:0@lo:101: 00010000:00010000:0.0:1788748220.592227:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.592235:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748220.592309:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990464:0@lo:501: 00000100:00100000:0.0:1788748220.592336:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.592575:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd7e7d14 going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.592631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990464 00000100:00100000:3.0:1788748220.592636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990464 00000100:00100000:3.0:1788748220.592726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748220.592732:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8bbe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990464:12345-0@lo:501: 00000100:00100000:3.0:1788748220.593342:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8bbe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990464:12345-0@lo:501: Request processed in 609us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.593350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748220.593490:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990464:0@lo:501: 00000100:00100000:0.0:1788748220.593521:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990592:0@lo:503: 00000100:00100000:0.0:1788748220.593557:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.593584:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd7e7d14 going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.593622:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990592 00000100:00100000:3.0:1788748220.593627:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990592 00000100:00100000:3.0:1788748220.593749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748220.593762:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b213ef87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990592:12345-0@lo:503: 00000040:00080000:3.0:1788748220.593796:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748220.593839:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b213ef87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990592:12345-0@lo:503: Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.593845:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748220.593902:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990592:0@lo:503: 00000040:00080000:1.0:1788748220.595461:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788748220.595630:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788748220.595713:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748220.595764:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.595776:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748220.595818:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748220.595820:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cec8720800 10000000:01000000:0.0:1788748220.595823:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cec8720800 10000000:01000000:0.0:1788748220.595827:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748220.595833:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec8720800 from 1 10000000:01000000:0.0:1788748220.595835:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748220.595866:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.595874:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.595893:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748220.595912:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990720:0@lo:101: 00000100:00100000:0.0:1788748220.596083:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.596247:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000008698568 going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.596319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990720 00000100:00100000:3.0:1788748220.596327:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990720 00000100:00100000:3.0:1788748220.596395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748220.596403:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005de756a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376990720:12345-0@lo:101: 00010000:00010000:3.0:1788748220.596414:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748220.596425:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000167f7af2/0x5b377f42a7a7bcfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bcf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.596460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000167f7af2/0x5b377f42a7a7bcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.596470:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000167f7af2/0x5b377f42a7a7bcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.596478:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000167f7af2, rc 0) 00000100:00100000:3.0:1788748220.596520:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005de756a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376990720:12345-0@lo:101: Request processed in 119us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.596527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748220.596603:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990720:0@lo:101: 00010000:00010000:0.0:1788748220.596615:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.596623:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748220.596682:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990848:0@lo:501: 00000100:00100000:0.0:1788748220.596707:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.596861:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000008698568 going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.596936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990848 00000100:00100000:1.0:1788748220.596941:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990848 00000100:00100000:1.0:1788748220.596964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748220.596983:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001122b42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376990848:12345-0@lo:501: 00000100:00100000:1.0:1788748220.597245:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001122b42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376990848:12345-0@lo:501: Request processed in 263us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.597252:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748220.597335:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990848:0@lo:501: 00000100:00100000:0.0:1788748220.597361:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990976:0@lo:503: 00000100:00100000:0.0:1788748220.597397:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.597425:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000008698568 going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.597525:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376990976 00000100:00100000:1.0:1788748220.597529:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376990976 00000100:00100000:1.0:1788748220.597556:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748220.597562:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091420963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376990976:12345-0@lo:503: 00000100:00100000:1.0:1788748220.597717:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091420963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376990976:12345-0@lo:503: Request processed in 155us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.597724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748220.597840:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376990976:0@lo:503: 00000100:00100000:0.0:1788748220.599314:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5872:1875638376991104:0@lo:502: 00000100:00100000:0.0:1788748220.599381:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.599419:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000006de75ce3 going to sleep for 11 seconds 00000100:00100000:1.0:1788748220.599470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991104 00000100:00100000:1.0:1788748220.599476:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991104 00000100:00100000:1.0:1788748220.599505:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748220.599512:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7d2d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5872:x1875638376991104:12345-0@lo:502: 00000100:00100000:1.0:1788748220.599756:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7d2d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5872:x1875638376991104:12345-0@lo:502: Request processed in 244us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748220.599763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748220.599850:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5872:1875638376991104:0@lo:502: 00000020:01000004:0.0:1788748220.599909:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788748220.599931:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000432015a1) 00000020:00000080:0.0:1788748220.599949:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788748220.600077:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000988ae846 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788748220.600081:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000988ae846 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788748220.600083:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000988ae846 4 00010000:00080000:0.0:1788748220.600109:0:5872:0:(ldlm_lib.c:103:import_set_conn()) imp 000000005c98c865@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788748220.601637:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788748220.601841:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788748220.601872:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788748220.601884:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b377f42a7a7bd0b 00000100:00080000:0.0:1788748220.601893:0:5872:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748220.601901:0:5872:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005c98c865 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748220.601935:0:5872:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042b640a2 x1875638376991232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748220.601967:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788748220.604703:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638376991232:0@lo:38: 00000100:00100000:3.0:1788748220.604778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748220.604989:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991232 00000100:00100000:0.0:1788748220.604998:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991232 00000100:00100000:0.0:1788748220.605048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748220.605054:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b7e193 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638376991232:12345-0@lo:38: 00000100:00100000:0.0:1788748220.605119:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b7e193 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638376991232:12345-0@lo:38: Request processed in 63us (343us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788748220.605125:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748220.605293:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748220.605302:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005c98c865 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748220.605307:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788748220.605318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b640a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638376991232:0@lo:38: 00000100:00100000:1.0:1788748220.605472:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e64f344f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5872:1875638376991360:0@lo:502: 00000100:00100000:1.0:1788748220.605515:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748220.605547:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d53101d going to sleep for 11 seconds 00000100:00100000:3.0:1788748220.605745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991360 00000100:00100000:3.0:1788748220.605750:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991360 00000100:00100000:3.0:1788748220.605787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748220.605793:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009144d83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5872:x1875638376991360:12345-0@lo:502: 00000100:00100000:3.0:1788748220.606079:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009144d83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5872:x1875638376991360:12345-0@lo:502: Request processed in 285us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748220.606087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748220.606240:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e64f344f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5872:1875638376991360:0@lo:502: 00000040:00080000:0.0:1788748220.606266:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788748220.606428:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788748220.606447:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748220.606466:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.606476:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000f5e41300/0x5b377f42a7a7bcf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788748220.606516:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788748220.606519:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748220.606520:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748220.606521:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748220.606523:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748220.606524:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748220.606525:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748220.606527:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748220.606528:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748220.606529:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748220.606531:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748220.606532:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748220.606535:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788748220.606537:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748220.606539:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748220.606540:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748220.606541:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748220.606548:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748220.606549:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748220.606550:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748220.606551:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748220.606552:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748220.606552:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748220.606553:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748220.606554:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748220.606570:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788748220.606579:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376991488:0@lo:253: 00000100:00100000:3.0:1788748220.606611:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748220.606742:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002454797c going to sleep for 11 seconds 00000100:00100000:0.0:1788748220.606780:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991488 00000100:00100000:0.0:1788748220.606786:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991488 00000100:00100000:0.0:1788748220.606820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748220.606833:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c489b043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5825:x1875638376991488:12345-0@lo:253: 20000000:01000000:0.0:1788748220.606854:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788748220.606867:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788748220.664968:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748220.664987:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788748220.665104:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788748220.665109:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788748220.665129:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.665337:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.665345:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.665386:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748220.665402:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 12 pid: 5836 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748220.665418:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a736755c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638376991616:0@lo:104: 00000100:00100000:3.0:1788748220.665481:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748220.665548:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991616 00000100:00100000:2.0:1788748220.665557:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991616 00000100:00100000:3.0:1788748220.665593:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062408490 going to sleep for 11 seconds 00000100:00100000:2.0:1788748220.665605:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748220.665615:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d078affc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638376991616:12345-0@lo:104: 00010000:00010000:2.0:1788748220.665627:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666196:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748220.666203:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d078affc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638376991616:12345-0@lo:104: Request processed in 591us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748220.666211:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788748220.666235:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748220.666240:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666248:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da854fe2 already unused, calling callback (00000000ae8c006b) 10000000:00010000:2.0:1788748220.666251:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666258:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748220.666265:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748220.666270:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748220.666311:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666318:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748220.666335:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666342:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000da854fe2/0x5b377f42a7a7bcda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bce1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.666357:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748220.666359:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748220.666360:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748220.666407:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748220.666418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060703df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376991744:0@lo:103: 00000100:00100000:2.0:1788748220.666452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748220.666603:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a736755c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638376991616:0@lo:104: 00010000:00010000:1.0:1788748220.666625:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.668103:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991744 00000100:00100000:2.0:1788748220.668113:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991744 00010000:00010000:2.0:1788748220.668197:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 13 pid: 5836 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748220.668274:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748220.668283:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001df45845 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638376991744:12345-0@lo:103: 00010000:00010000:2.0:1788748220.668296:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748220.668301:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 13 pid: 5836 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668312:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 13 pid: 5836 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668326:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094d955f4/0x5b377f42a7a7bce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bcda expref: 13 pid: 5836 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668351:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668358:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748220.668373:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003264672s 00010000:00010000:2.0:1788748220.668377:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668383:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668388:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668394:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668399:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010897775 already unused, calling callback (00000000cec6877b) 00010000:00010000:2.0:1788748220.668402:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668409:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668429:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748220.668439:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748220.668508:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001df45845 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3306:x1875638376991744:12345-0@lo:103: Request processed in 226us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748220.668516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788748220.668536:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.668550:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748220.668556:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010897775/0x5b377f42a7a7bd12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748220.669854:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060703df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376991744:0@lo:103: 00000100:00100000:2.0:1788748220.695662:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c489b043 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5825:x1875638376991488:12345-0@lo:253: Request processed in 88822us (89042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748220.695677:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748220.696053:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5825:1875638376991488:0@lo:253: 10000000:01000000:3.0:1788748220.696070:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788748220.696073:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748220.696075:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748220.696076:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748220.696077:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748220.696078:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748220.696079:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748220.696081:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748220.696082:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748220.696083:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748220.696084:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748220.696086:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748220.696087:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788748220.696101:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788748220.705533:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.705867:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748220.706113:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.706298:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748220.706562:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748220.706749:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748220.712005:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748220.712386:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748220.713959:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748220.714285:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748220.714792:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748220.714983:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788748220.798930:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788748220.846240:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788748220.846295:0:5877:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788748220.846300:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788748220.849387:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788748220.852884:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788748220.853151:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788748220.853719:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788748220.853728:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788748220.853917:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748220.863125:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788748220.864296:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788748220.864340:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788748220.864583:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788748220.865130:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788748220.866268:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788748220.866411:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788748220.866569:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788748220.866767:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788748220.867004:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788748220.867161:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788748220.867302:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788748220.867502:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788748220.867618:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788748220.867733:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788748220.867849:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788748220.867965:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788748220.868115:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788748220.868248:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788748220.868381:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788748220.868496:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788748220.868749:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788748220.868864:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788748220.868978:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788748220.869131:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788748220.870106:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788748220.870257:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788748220.870378:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788748220.870499:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788748220.870717:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788748220.870864:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788748220.871010:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788748220.871203:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788748220.871373:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788748220.871562:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788748220.872797:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788748220.872944:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788748220.873193:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788748220.906846:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788748220.990619:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788748220.990654:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6f541b3f988 00100000:10000000:0.0:1788748220.990662:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788748220.999413:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788748220.999429:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788748220.999443:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788748220.999478:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788748221.045282:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748221.045380:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788748221.045385:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788748221.549326:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748222.574049:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748223.610441:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748224.621191:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748225.645464:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748225.773175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788748225.773185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788748225.773188:0:37:0:(import.c:65:import_set_state_nolock()) 000000005c98c865 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748225.773203:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005c98c865 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748225.773221:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db8d9aa0 x1875638376992000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748225.773290:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748225.773303:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aed49d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376991872:0@lo:400: 00000100:00100000:0.0:1788748225.773361:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748225.773416:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db8d9aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638376992000:0@lo:38: 00000100:00100000:0.0:1788748225.773491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748225.773530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376991872 00000100:00100000:0.0:1788748225.773537:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376991872 00000100:00100000:0.0:1788748225.773571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748225.773577:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008136da8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:3309:x1875638376991872:12345-0@lo:400: 00000100:00100000:0.0:1788748225.773618:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008136da8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:3309:x1875638376991872:12345-0@lo:400: Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748225.773624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748225.773679:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aed49d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376991872:0@lo:400: 00000100:00100000:1.0:1788748225.773951:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992000 00000100:00100000:1.0:1788748225.773956:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992000 00000100:00100000:1.0:1788748225.773982:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748225.774090:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000679ac586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875638376992000:12345-0@lo:38: 00010000:00080000:1.0:1788748225.774111:0:5846:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1788748225.774152:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b377f42a7a7bd19 00000004:00100000:1.0:1788748225.774189:0:5846:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788748225.774302:0:5846:0:(import.c:65:import_set_state_nolock()) 000000000d5e3598 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748225.774342:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000679ac586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875638376992000:12345-0@lo:38: Request processed in 252us (852us total) trans 0 rc 0/0 00010000:00080000:3.0:1788748225.774393:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000db8d9aa0 x1875638376992000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748225.774406:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788748225.774412:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788748225.774416:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788748225.774417:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005c98c865 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788748225.774421:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db8d9aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638376992000:0@lo:38: 00000100:00100000:1.0:1788748225.776067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:02000400:1.0:1788748226.255922:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788748226.669791:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748227.693497:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748227.822639:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788748227.822670:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cec8720800 from 3 10000000:01000000:3.0:1788748227.822677:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788748227.822740:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748227.822756:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748227.822769:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748227.822797:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992128:0@lo:101: 00000100:00100000:3.0:1788748227.822892:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748227.822968:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e564d1b going to sleep for 11 seconds 00000100:00100000:1.0:1788748227.823385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992128 00000100:00100000:1.0:1788748227.823402:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992128 00000100:00100000:1.0:1788748227.823471:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748227.823479:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7afa6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5841:x1875638376992128:12345-0@lo:101: 00010000:00010000:1.0:1788748227.823497:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748227.823519:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055d202b8/0x5b377f42a7a7bd27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd20 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748227.823545:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055d202b8/0x5b377f42a7a7bd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748227.823574:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055d202b8/0x5b377f42a7a7bd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748227.823582:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055d202b8, rc 0) 00000100:00100000:1.0:1788748227.823674:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7afa6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376992128:12345-0@lo:101: Request processed in 196us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748227.823681:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748227.823987:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992128:0@lo:101: 00010000:00010000:3.0:1788748227.824036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748227.824049:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748227.824113:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992256:0@lo:256: 00000100:00100000:3.0:1788748227.824177:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748227.824201:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e564d1b going to sleep for 11 seconds 00000100:00100000:3.0:1788748227.824221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992256 00000100:00100000:3.0:1788748227.824227:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992256 00000100:00100000:3.0:1788748227.824272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748227.824279:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e517bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376992256:12345-0@lo:256: 20000000:01000000:3.0:1788748227.824300:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748227.824403:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748227.824407:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788748227.824499:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e517bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376992256:12345-0@lo:256: Request processed in 221us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748227.824509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748227.824555:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992256:0@lo:256: 10000000:01000000:3.0:1788748227.824601:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788748227.824610:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748227.824618:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000005dd1f2ec/0x5b377f42a7a7bd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748228.719551:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748229.741192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748230.765391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748230.894225:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748230.894246:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638376992384:0@lo:400: 00000100:00100000:3.0:1788748230.894310:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748230.894374:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009643ebfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638376992512:0@lo:400: 00000100:00100000:3.0:1788748230.894440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748230.894493:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992384 00000100:00100000:3.0:1788748230.894502:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992384 00000100:00100000:3.0:1788748230.894547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748230.894556:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000688eb3da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3308:x1875638376992384:12345-0@lo:400: 00000100:00100000:3.0:1788748230.894604:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000688eb3da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3308:x1875638376992384:12345-0@lo:400: Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748230.894611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748230.894644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992512 00000100:00100000:3.0:1788748230.894648:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992512 00000100:00100000:3.0:1788748230.894679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748230.894683:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff25bc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638376992512:12345-0@lo:400: 00000100:00100000:3.0:1788748230.894717:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff25bc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638376992512:12345-0@lo:400: Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748230.894722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748230.894769:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009643ebfd x1875638376992512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748230.894782:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009643ebfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638376992512:0@lo:400: 00000100:00100000:3.0:1788748230.894811:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638376992384:0@lo:400: 00000020:00000080:1.0:1788748231.084572:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4e050e40 20000000:00000080:1.0:1788748231.084591:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cefd74a000 uarg=0000000000000000 20000000:01000000:1.0:1788748231.085129:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788748231.085138:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788748231.085142:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788748231.085444:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788748231.085456:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788748231.088191:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748231.088373:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788748231.088410:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788748231.088436:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788748231.088447:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788748231.088461:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.088474:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.088479:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.088518:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.088531:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 11 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748231.088545:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb2331ba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875638376992640:0@lo:104: 00000100:00100000:1.0:1788748231.088604:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748231.088694:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097c3f0ee going to sleep for 11 seconds 00000100:00100000:0.0:1788748231.088734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992640 00000100:00100000:0.0:1788748231.088775:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992640 00000100:00100000:2.0:1788748231.088853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748231.088863:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3128deb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:6323:x1875638376992640:12345-0@lo:104: 00010000:00010000:2.0:1788748231.088875:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748231.088960:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748231.088965:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3128deb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:6323:x1875638376992640:12345-0@lo:104: Request processed in 105us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748231.088972:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748231.089011:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb2331ba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875638376992640:0@lo:104: 00010000:00010000:0.0:1788748231.089087:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748231.089093:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089120:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba35a661 already unused, calling callback (00000000ae8c006b) 10000000:00010000:0.0:1788748231.089122:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089129:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.089133:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748231.089134:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748231.089141:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788748231.089166:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089173:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748231.089192:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089202:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000ba35a661/0x5b377f42a7a7bce8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089216:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748231.089217:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748231.089219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748231.089244:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aed49d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638376992768:0@lo:103: 00000100:00100000:1.0:1788748231.089270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748231.089301:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992768 00000100:00100000:0.0:1788748231.089305:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992768 00010000:00010000:0.0:1788748231.089322:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748231.089350:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748231.089362:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2331ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3307:x1875638376992768:12345-0@lo:103: 00010000:00010000:0.0:1788748231.089373:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748231.089377:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089387:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089398:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003bc72b4b/0x5b377f42a7a7bcef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bce8 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089407:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089411:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089419:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089423:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089427:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089430:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089433:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ccd4d455 already unused, calling callback (00000000cec6877b) 00010000:00010000:0.0:1788748231.089435:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089443:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089455:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748231.089463:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748231.089473:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.089480:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748231.089486:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ccd4d455/0x5b377f42a7a7bd2e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748231.089492:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2331ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:3307:x1875638376992768:12345-0@lo:103: Request processed in 133us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748231.089498:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748231.089520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aed49d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638376992768:0@lo:103: 00010000:00010000:1.0:1788748231.792552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748232.818839:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748233.837201:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748234.863188:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748235.503516:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748235.503524:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec8720800 from 1 10000000:01000000:3.0:1788748235.503529:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748235.503586:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000005669b9cb/0x5b377f42a7a7bd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748235.503597:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000005669b9cb/0x5b377f42a7a7bd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748235.503608:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000005669b9cb/0x5b377f42a7a7bd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748235.503632:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992896:0@lo:101: 00000100:00100000:3.0:1788748235.503699:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748235.503755:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002ff42d2 going to sleep for 11 seconds 00000100:00100000:0.0:1788748235.504088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376992896 00000100:00100000:0.0:1788748235.504097:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376992896 00000100:00100000:0.0:1788748235.504140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748235.504165:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001176c322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:5841:x1875638376992896:12345-0@lo:101: 00010000:00010000:0.0:1788748235.504181:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748235.504196:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bfcda04/0x5b377f42a7a7bd3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd35 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748235.504219:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bfcda04/0x5b377f42a7a7bd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748235.504229:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bfcda04/0x5b377f42a7a7bd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748235.504238:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bfcda04, rc 0) 00000100:00100000:0.0:1788748235.504300:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001176c322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376992896:12345-0@lo:101: Request processed in 137us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748235.504308:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748235.505194:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be99d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376992896:0@lo:101: 00010000:00010000:2.0:1788748235.505217:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000005669b9cb/0x5b377f42a7a7bd35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748235.505226:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000005669b9cb/0x5b377f42a7a7bd35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748235.505297:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0f66e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376993024:0@lo:501: 00000100:00100000:2.0:1788748235.505335:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748235.505361:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b536d06 going to sleep for 11 seconds 00000100:00100000:3.0:1788748235.505716:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993024 00000100:00100000:3.0:1788748235.505722:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993024 00000100:00100000:3.0:1788748235.505763:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748235.505769:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abae6b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376993024:12345-0@lo:501: 00000100:00100000:3.0:1788748235.508053:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abae6b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376993024:12345-0@lo:501: Request processed in 2278us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748235.508065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748235.508158:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0f66e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376993024:0@lo:501: 00000100:00100000:1.0:1788748235.508219:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d3691c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376993152:0@lo:503: 00000100:00100000:1.0:1788748235.508278:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748235.508315:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1897bfa going to sleep for 11 seconds 00000100:00100000:3.0:1788748235.508940:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993152 00000100:00100000:3.0:1788748235.508948:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993152 00000100:00100000:3.0:1788748235.508989:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748235.508997:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029847a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376993152:12345-0@lo:503: 00000100:00100000:3.0:1788748235.509293:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029847a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376993152:12345-0@lo:503: Request processed in 296us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748235.509301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748235.509489:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d3691c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376993152:0@lo:503: 00000100:00100000:3.0:1788748235.514397:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009643ebfd pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6651:1875638376993280:0@lo:502: 00000100:00100000:3.0:1788748235.514503:0:6651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748235.514542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993280 00000100:00100000:3.0:1788748235.514549:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993280 00000100:00100000:3.0:1788748235.514609:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748235.514620:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000fae2605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6651:x1875638376993280:12345-0@lo:502: 00000100:00100000:3.0:1788748235.514895:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000fae2605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6651:x1875638376993280:12345-0@lo:502: Request processed in 278us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748235.514903:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748235.514959:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c343de4b going to sleep for 11 seconds 00000100:00100000:3.0:1788748235.514979:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009643ebfd pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6651:1875638376993280:0@lo:502: 00000020:01000000:3.0:1788748235.515005:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748235.517774:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748235.517782:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788748235.517798:0:6651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec8720800 00000020:00000080:3.0:1788748235.517802:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788748235.517863:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6651:1875638376993408:0@lo:502: 00000100:00100000:3.0:1788748235.517945:0:6651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748235.517985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993408 00000100:00100000:3.0:1788748235.517992:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993408 00000100:00100000:3.0:1788748235.518462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748235.518473:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6651:x1875638376993408:12345-0@lo:502: 00000100:00100000:3.0:1788748235.518792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6651:x1875638376993408:12345-0@lo:502: Request processed in 321us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748235.518801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748235.518855:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748235.518877:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6651:1875638376993408:0@lo:502: 00000020:01000000:3.0:1788748235.518904:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748235.518910:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748235.518912:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788748235.518916:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788748235.519504:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788748235.519527:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748235.519538:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748235.519614:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748235.887223:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748236.014594:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638376993664:0@lo:400: 00000100:00100000:1.0:1788748236.014691:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.014766:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748236.014771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376993536:0@lo:400: 00000100:00100000:1.0:1788748236.014796:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.014887:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993664 00000100:00100000:2.0:1788748236.014895:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993664 00000100:00100000:2.0:1788748236.014948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748236.014957:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638376993664:12345-0@lo:400: 00000100:00100000:2.0:1788748236.015011:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638376993664:12345-0@lo:400: Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.015039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748236.015102:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cef76a9180 x1875638376993664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748236.015125:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638376993664:0@lo:400: 00000100:00100000:0.0:1788748236.015192:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993536 00000100:00100000:0.0:1788748236.015197:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993536 00000100:00100000:0.0:1788748236.015231:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788748236.015239:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3309:x1875638376993536:12345-0@lo:400: 00000100:00100000:0.0:1788748236.015376:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3309:x1875638376993536:12345-0@lo:400: Request processed in 138us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.015382:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748236.015444:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376993536:0@lo:400: 00000020:01000004:0.0:1788748236.513095:0:6691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788748236.513099:0:6691:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788748236.513246:0:6691:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ceecff9800 00000020:01000004:0.0:1788748236.513265:0:6691:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788748236.513277:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788748236.513291:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99cefd4a3380) 00000020:00000080:0.0:1788748236.513308:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788748236.534486:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788748236.534850:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788748236.549756:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788748236.553735:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788748236.553766:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788748236.553819:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788748236.553846:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788748236.554250:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788748236.554261:0:6691:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788748236.554272:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7bd4a 00000020:01000004:3.0:1788748236.554279:0:6691:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788748236.554299:0:6691:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788748236.554308:0:6691:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788748236.554314:0:6691:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788748236.554319:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788748236.554329:0:6691:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ceecf90000) 00000020:00000080:3.0:1788748236.554339:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788748236.555435:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748236.555617:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748236.555624:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788748236.564352:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748236.564374:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788748236.564926:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788748236.564934:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788748236.570777:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748236.571042:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748236.571050:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788748236.571649:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788748236.571658:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788748236.601551:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748236.601796:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748236.601802:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788748236.604148:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748236.604161:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788748236.606914:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788748236.606932:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788748236.612924:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748236.613343:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748236.613350:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788748236.614443:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788748236.614453:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788748236.688060:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748236.688447:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748236.688454:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788748236.699636:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788748236.699652:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788748236.706279:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788748236.706316:0:6691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788748236.706324:0:6691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788748236.754733:0:6691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788748236.754770:0:6691:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788748236.754775:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788748236.754776:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748236.754778:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748236.754779:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748236.754780:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748236.754782:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748236.754784:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748236.754786:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748236.754787:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748236.754789:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748236.754790:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748236.754794:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788748236.754796:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748236.754798:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748236.754799:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748236.754800:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748236.754801:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748236.754802:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748236.754803:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748236.754804:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748236.754805:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748236.754806:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748236.754808:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748236.754833:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788748236.754854:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376993792:0@lo:253: 00000100:00100000:2.0:1788748236.754931:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.755221:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef6ef23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748236.755272:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993792 00000100:00100000:3.0:1788748236.755280:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993792 00000100:00100000:3.0:1788748236.755335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748236.755345:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376993792:12345-0@lo:253: 20000000:01000000:3.0:1788748236.755383:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788748236.755400:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788748236.755405:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788748236.755408:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788748236.756316:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748236.756576:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788748236.756602:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788748236.756640:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788748236.756649:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788748236.756676:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788748236.756720:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788748236.757000:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788748236.757127:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1788748236.757130:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788748236.757170:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788748236.757181:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788748236.757233:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788748236.757245:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1788748236.757277:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788748236.757288:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788748236.757333:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788748236.757385:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788748236.758096:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788748236.758115:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1788748236.758117:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788748236.758146:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788748236.758153:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788748236.758178:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788748236.758185:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1788748236.758230:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788748236.758242:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788748236.758277:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788748236.758317:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788748236.758346:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788748236.758350:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788748236.758354:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788748236.758368:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788748236.758371:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788748236.758406:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788748236.758410:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788748236.759226:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788748236.759426:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788748236.759453:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788748236.759507:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788748236.759518:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788748236.759519:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788748236.759927:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788748236.759975:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788748236.760052:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788748236.760640:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788748236.760686:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788748236.760726:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788748236.760741:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788748236.760743:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788748236.761515:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788748236.761680:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788748236.761746:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788748236.762147:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788748236.762187:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788748236.762256:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788748236.762273:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788748236.762275:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788748236.762283:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788748236.762301:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762319:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762330:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762337:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762348:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762389:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762403:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 12 pid: 5836 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.762417:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376993920:0@lo:104: 00000100:00100000:3.0:1788748236.762490:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748236.762583:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376993920 00000100:00100000:0.0:1788748236.762591:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376993920 00010000:00010000:3.0:1788748236.762629:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748236.762638:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788748236.762642:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748236.762651:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638376993920:12345-0@lo:104: 00000100:00100000:3.0:1788748236.762657:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376994048:0@lo:104: 00010000:00010000:0.0:1788748236.762665:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.762684:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748236.762708:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762718:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 12 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.762727:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376994176:0@lo:104: 00010000:00010000:0.0:1788748236.762731:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748236.762739:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638376993920:12345-0@lo:104: Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.762746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748236.762753:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748236.762765:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefc3c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.762777:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994048 00000100:00100000:0.0:1788748236.762781:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994048 00000100:00100000:3.0:1788748236.762792:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376993920:0@lo:104: 00000100:00100000:0.0:1788748236.762796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994176 00000100:00100000:0.0:1788748236.762799:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994176 00000100:00100000:0.0:1788748236.762817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748236.762823:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638376994048:12345-0@lo:104: 00010000:00010000:0.0:1788748236.762831:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.762868:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788748236.762873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638376994048:12345-0@lo:104: Request processed in 50us (189us total) trans 0 rc 0/0 00010000:00010000:3.0:1788748236.762877:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748236.762885:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762895:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748236.762899:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.762908:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748236.762916:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748236.762921:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788748236.762978:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748236.762990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748236.762995:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638376994176:12345-0@lo:104: 00010000:00010000:0.0:1788748236.763002:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763050:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763058:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748236.763077:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788748236.763083:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638376994176:12345-0@lo:104: Request processed in 88us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1788748236.763088:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748236.763090:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788748236.763098:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec0031a00/0x5b377f42a7a7bcf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763113:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748236.763116:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763122:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d200 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748236.763125:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.763126:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748236.763140:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748236.763147:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748236.763152:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748236.763167:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763173:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748236.763180:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763187:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d200/0x5b377f42a7a7bc86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc8d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748236.763204:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748236.763206:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748236.763221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376994304:0@lo:103: 00000100:00100000:3.0:1788748236.763256:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748236.763261:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.763269:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.763284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788748236.763285:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147cc00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748236.763291:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.763294:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376994432:0@lo:103: 00000100:00100000:3.0:1788748236.763320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748236.763369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994304 00000100:00100000:3.0:1788748236.763374:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994304 00010000:00010000:3.0:1788748236.763394:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 13 pid: 5836 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.763433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994432 00000100:00100000:3.0:1788748236.763437:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994432 00010000:00010000:3.0:1788748236.763450:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.763465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748236.763472:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3306:x1875638376994304:12345-0@lo:103: 00010000:00010000:3.0:1788748236.763482:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748236.763487:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 14 pid: 5836 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763496:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 14 pid: 5836 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763513:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bcfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bcf6 expref: 14 pid: 5836 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.763515:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788748236.763527:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788748236.763532:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748236.763638:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638376994304:12345-0@lo:103: Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.763645:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748236.763660:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748236.763666:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3306:x1875638376994432:12345-0@lo:103: 00010000:00010000:3.0:1788748236.763674:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748236.763679:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763687:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.763703:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748236.763725:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3306:x1875638376994432:12345-0@lo:103: Request processed in 60us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.763731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788748236.763764:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bc8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bc86 expref: 11 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.763773:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376994048:0@lo:104: 00000100:00100000:3.0:1788748236.763782:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638376994176:0@lo:104: 00010000:00010000:3.0:1788748236.763801:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.763944:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748236.763951:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748236.763962:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748236.763989:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.763995:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748236.764043:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764050:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bc6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bc71 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748236.764056:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638376994560:0@lo:103: 00010000:00010000:1.0:1788748236.764086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.764088:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.764091:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748236.764102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748236.764159:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.764162:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748236.764197:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994560 00000100:00100000:1.0:1788748236.764202:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994560 00010000:00010000:1.0:1788748236.764221:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.764246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748236.764253:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:3308:x1875638376994560:12345-0@lo:103: 00010000:00010000:1.0:1788748236.764261:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748236.764266:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764274:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764311:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02057000/0x5b377f42a7a7bc71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bc6a expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764327:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764335:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.764348:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376994432:0@lo:103: 00010000:00010000:1.0:1788748236.764348:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764363:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.764366:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638376994304:0@lo:103: 00010000:00010000:1.0:1788748236.764378:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764386:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764391:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748236.764395:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764403:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764420:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.764439:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748236.764441:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.764453:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.764460:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bd58 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748236.764471:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788748236.764771:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:3308:x1875638376994560:12345-0@lo:103: Request processed in 519us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748236.764778:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748236.764819:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638376994560:0@lo:103: 00000100:00100000:3.0:1788748236.820886:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:6691:x1875638376993792:12345-0@lo:253: Request processed in 65534us (65946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.820903:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748236.820931:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376993792:0@lo:253: 10000000:01000000:2.0:1788748236.820947:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788748236.820950:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748236.820952:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748236.820954:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748236.820955:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788748236.820956:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748236.820958:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748236.820959:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748236.820961:0:6691:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788748236.820962:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748236.820964:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748236.820983:0:6691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ceecff9800 from lustre-OST0000 10000000:01000000:2.0:1788748236.821007:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788748236.821010:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788748236.821036:0:6691:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cee507b380 local copy 10000000:01000000:2.0:1788748236.821057:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788748236.821109:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.821121:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.821132:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.821152:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994688:0@lo:101: 00000100:00100000:2.0:1788748236.821188:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.821292:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefc3c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.821407:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994688 00000100:00100000:0.0:1788748236.821415:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994688 00000100:00100000:0.0:1788748236.821495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748236.821505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:6691:x1875638376994688:12345-0@lo:101: 00010000:00010000:0.0:1788748236.821533:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748236.821555:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7bd66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd5f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.821580:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7bd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd5f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.821591:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7bd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd5f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.821599:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031a00, rc 0) 00000100:00100000:0.0:1788748236.821671:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:6691:x1875638376994688:12345-0@lo:101: Request processed in 168us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.821677:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748236.821768:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994688:0@lo:101: 00010000:00010000:1.0:1788748236.821781:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.821790:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.821878:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994816:0@lo:501: 00000100:00100000:1.0:1788748236.821900:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.821980:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.822142:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994816 00000100:00100000:2.0:1788748236.822146:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994816 00000100:00100000:2.0:1788748236.822168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748236.822176:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:6691:x1875638376994816:12345-0@lo:501: 00000100:00100000:2.0:1788748236.822395:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:6691:x1875638376994816:12345-0@lo:501: Request processed in 219us (492us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748236.822402:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748236.822481:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994816:0@lo:501: 10000000:01000000:1.0:1788748236.822494:0:6691:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788748236.822518:0:6691:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788748236.822524:0:6691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.822542:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.822550:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.822576:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788748236.822600:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ceecff9800 10000000:01000000:1.0:1788748236.822604:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788748236.822609:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99cee507b380 10000000:01000000:1.0:1788748236.822611:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788748236.822615:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99cee507b380 from 1 10000000:01000000:1.0:1788748236.822617:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788748236.822636:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.822644:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.822651:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.822662:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994944:0@lo:101: 00000100:00100000:1.0:1788748236.822687:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.822708:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00010000:00010000:2.0:1788748236.822815:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748236.822822:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.822830:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748236.822835:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.822843:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748236.822861:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748236.822868:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748236.822885:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.822891:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748236.822918:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.822926:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7bd66 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.822942:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748236.822944:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748236.822945:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748236.822954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376994944 00000100:00100000:2.0:1788748236.822958:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376994944 00000100:00100000:2.0:1788748236.822978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748236.822984:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:6691:x1875638376994944:12345-0@lo:101: 00010000:00010000:2.0:1788748236.822992:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748236.823003:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147c600/0x5b377f42a7a7bd74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd6d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823050:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147c600/0x5b377f42a7a7bd74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd6d expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823059:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147c600/0x5b377f42a7a7bd74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd6d expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823083:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c600, rc 0) 00000100:00100000:2.0:1788748236.823112:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376994944:12345-0@lo:101: Request processed in 128us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.823119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748236.823201:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376995072:0@lo:103: 00000100:00100000:1.0:1788748236.823230:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.823290:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376994944:0@lo:101: 00010000:00010000:1.0:1788748236.823302:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.823310:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748236.823324:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788748236.823333:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.823346:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748236.823354:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788748236.823358:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748236.823362:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788748236.823365:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748236.823381:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.823389:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.823397:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.823409:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995200:0@lo:101: 00000100:00100000:1.0:1788748236.823433:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.823445:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.823500:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995072 00000100:00100000:2.0:1788748236.823505:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995072 00000100:00100000:2.0:1788748236.823551:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748236.823558:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:3309:x1875638376995072:12345-0@lo:103: 00010000:00010000:2.0:1788748236.823568:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748236.823581:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7bd66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bd5f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823594:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748236.823626:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:3309:x1875638376995072:12345-0@lo:103: Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.823633:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748236.823656:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638376995072:0@lo:103: 00000100:00100000:2.0:1788748236.823670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995200 00000100:00100000:2.0:1788748236.823674:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995200 00000100:00100000:2.0:1788748236.823688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748236.823693:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+10:6691:x1875638376995200:12345-0@lo:101: 00010000:00010000:2.0:1788748236.823701:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748236.823709:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd7b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823725:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823741:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.823748:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d400, rc 0) 00000100:00100000:2.0:1788748236.823774:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995200:12345-0@lo:101: Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.823780:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748236.823911:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995200:0@lo:101: 00010000:00010000:1.0:1788748236.823922:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.823929:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.824051:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995328:0@lo:501: 00000100:00100000:1.0:1788748236.824093:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.824110:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.824177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995328 00000100:00100000:0.0:1788748236.824183:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995328 00000100:00100000:0.0:1788748236.824205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748236.824211:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995328:12345-0@lo:501: 00000100:00100000:0.0:1788748236.824414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995328:12345-0@lo:501: Request processed in 203us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.824421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748236.824501:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995328:0@lo:501: 00000100:00100000:1.0:1788748236.824527:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995456:0@lo:503: 00000100:00100000:1.0:1788748236.824631:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.824662:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.824713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995456 00000100:00100000:0.0:1788748236.824718:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995456 00000100:00100000:0.0:1788748236.824734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748236.824739:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995456:12345-0@lo:503: 00000100:00100000:0.0:1788748236.824900:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995456:12345-0@lo:503: Request processed in 159us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.824907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748236.824987:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995456:0@lo:503: 00000040:00080000:1.0:1788748236.825320:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748236.825391:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995584:0@lo:502: 00000100:00100000:1.0:1788748236.825428:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.825447:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.825859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995584 00000100:00100000:2.0:1788748236.825863:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995584 00000100:00100000:2.0:1788748236.825882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788748236.825887:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995584:12345-0@lo:502: 00000100:00100000:2.0:1788748236.826043:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995584:12345-0@lo:502: Request processed in 155us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.826048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748236.826175:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995584:0@lo:502: 00000040:00080000:1.0:1788748236.826427:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788748236.826475:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788748236.826502:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788748236.826530:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788748236.826631:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788748236.826666:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788748236.826695:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995712:0@lo:502: 00000100:00100000:1.0:1788748236.826734:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.826769:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.826823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995712 00000100:00100000:2.0:1788748236.826828:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995712 00000100:00100000:2.0:1788748236.826905:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788748236.826913:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995712:12345-0@lo:502: 00000100:00100000:2.0:1788748236.827080:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995712:12345-0@lo:502: Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.827088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748236.827159:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995712:0@lo:502: 00000040:00080000:1.0:1788748236.827236:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788748236.827244:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788748236.827907:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748236.827916:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788748236.827928:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748236.827931:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788748236.827936:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748236.827957:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99cdc4e24d40) 00000020:00000080:1.0:1788748236.827977:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788748236.827983:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748236.828209:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ceecff9800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788748236.828217:0:6714:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748236.828225:0:6714:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7bd90 00010000:00010000:1.0:1788748236.832466:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788748236.832830:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788748236.835532:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788748236.835890:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788748236.841952:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788748236.842551:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788748236.844008:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788748236.844182:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748236.844333:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748236.844337:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788748236.844342:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748236.844347:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748236.844349:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748236.844352:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748236.844354:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748236.844412:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748236.844415:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748236.844417:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788748236.844420:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788748236.844578:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788748236.844607:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788748236.844632:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.844644:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748236.844661:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecff9800 from 1 10000000:01000000:2.0:1788748236.844664:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748236.844699:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.844707:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.844718:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.844743:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995840:0@lo:101: 00000100:00100000:2.0:1788748236.844824:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.844879:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced3266540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748236.844889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995840 00000100:00100000:3.0:1788748236.844899:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995840 00000100:00100000:3.0:1788748236.844954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748236.844965:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:6691:x1875638376995840:12345-0@lo:101: 00010000:00010000:3.0:1788748236.844978:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748236.844992:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bd97 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.845042:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.845075:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.845086:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43800, rc 0) 00000100:00100000:3.0:1788748236.845135:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376995840:12345-0@lo:101: Request processed in 172us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.845142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748236.845264:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995840:0@lo:101: 00010000:00010000:2.0:1788748236.845279:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.845289:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.845371:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995968:0@lo:501: 00000100:00100000:2.0:1788748236.845396:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.845425:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced3266540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748236.845511:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376995968 00000100:00100000:3.0:1788748236.845516:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376995968 00000100:00100000:3.0:1788748236.845545:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748236.845553:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376995968:12345-0@lo:501: 00000100:00100000:3.0:1788748236.845781:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376995968:12345-0@lo:501: Request processed in 228us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.845789:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748236.847028:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376995968:0@lo:501: 00000100:00100000:1.0:1788748236.849761:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996096:0@lo:503: 00000100:00100000:1.0:1788748236.849850:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.849943:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.850649:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996096 00000100:00100000:0.0:1788748236.850660:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996096 00000100:00100000:0.0:1788748236.850716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748236.850728:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996096:12345-0@lo:503: 00000100:00100000:0.0:1788748236.851058:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996096:12345-0@lo:503: Request processed in 332us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.851081:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748236.851118:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996096:0@lo:503: 00000040:00080000:3.0:1788748236.851505:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748236.851572:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996224:0@lo:502: 00000100:00100000:3.0:1788748236.851625:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748236.851666:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.851737:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996224 00000100:00100000:2.0:1788748236.851743:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996224 00000100:00100000:2.0:1788748236.851836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748236.851846:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996224:12345-0@lo:502: 00000100:00100000:2.0:1788748236.851997:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996224:12345-0@lo:502: Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.852044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748236.852384:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996224:0@lo:502: 00000040:00080000:1.0:1788748236.853238:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788748236.853303:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788748236.853341:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996352:0@lo:502: 00000100:00100000:1.0:1788748236.853400:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.853544:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.853587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996352 00000100:00100000:0.0:1788748236.853595:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996352 00000100:00100000:0.0:1788748236.853685:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748236.853695:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996352:12345-0@lo:502: 00000100:00100000:0.0:1788748236.853921:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996352:12345-0@lo:502: Request processed in 227us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.853929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748236.854196:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996352:0@lo:502: 00000040:00080000:1.0:1788748236.854288:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788748236.854298:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788748236.854820:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748236.854828:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748236.854830:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788748236.854834:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ceecff9800 00000020:00000080:2.0:1788748236.854836:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748236.854851:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748236.854853:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748236.854854:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788748236.854856:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788748236.854908:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788748236.854939:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748236.855005:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.855050:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748236.855105:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788748236.855109:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ceecff9800 10000000:01000000:1.0:1788748236.855113:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ceecff9800 10000000:01000000:1.0:1788748236.855118:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748236.855125:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ceecff9800 from 1 10000000:01000000:1.0:1788748236.855127:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748236.855158:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.855167:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.855178:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.855204:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996480:0@lo:101: 00000100:00100000:1.0:1788748236.855249:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.855289:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996480 00000100:00100000:1.0:1788748236.855294:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.855296:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996480 00000100:00100000:2.0:1788748236.855377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748236.855384:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376996480:12345-0@lo:101: 00010000:00010000:2.0:1788748236.855394:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748236.855405:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bda5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.855429:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.855439:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.855448:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147ce00, rc 0) 00000100:00100000:2.0:1788748236.855493:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996480:12345-0@lo:101: Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.855506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748236.855536:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996480:0@lo:101: 00010000:00010000:3.0:1788748236.855551:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748236.855560:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748236.855643:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996608:0@lo:501: 00000100:00100000:3.0:1788748236.855670:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748236.855700:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.855701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996608 00000100:00100000:0.0:1788748236.855707:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996608 00000100:00100000:0.0:1788748236.855736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748236.855742:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996608:12345-0@lo:501: 00000100:00100000:0.0:1788748236.855947:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996608:12345-0@lo:501: Request processed in 204us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748236.855953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748236.856037:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996608:0@lo:501: 00000100:00100000:1.0:1788748236.856194:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996736:0@lo:503: 00000100:00100000:1.0:1788748236.856223:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.856243:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56180 going to sleep for 11 seconds 00000100:00100000:2.0:1788748236.856252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996736 00000100:00100000:2.0:1788748236.856256:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996736 00000100:00100000:2.0:1788748236.856287:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788748236.856294:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996736:12345-0@lo:503: 00000100:00100000:2.0:1788748236.856441:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996736:12345-0@lo:503: Request processed in 146us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.856448:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788748236.856457:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996736:0@lo:503: 00000040:00080000:1.0:1788748236.856685:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748236.856731:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996864:0@lo:502: 00000100:00100000:1.0:1788748236.856760:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.856779:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.856814:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996864 00000100:00100000:0.0:1788748236.856818:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996864 00000100:00100000:0.0:1788748236.856863:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788748236.856869:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996864:12345-0@lo:502: 00000100:00100000:0.0:1788748236.857004:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996864:12345-0@lo:502: Request processed in 135us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.857044:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996864:0@lo:502: 00000100:00100000:0.0:1788748236.857105:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:2.0:1788748236.857333:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788748236.857378:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788748236.857397:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788748236.857435:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788748236.857473:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788748236.857505:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788748236.857526:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788748236.857542:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788748236.857564:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788748236.857596:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788748236.857613:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788748236.857640:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788748236.857659:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788748236.857675:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788748236.857697:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788748236.857714:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788748236.857731:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788748236.857773:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788748236.857793:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788748236.857818:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788748236.857885:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788748236.857924:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788748236.857954:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788748236.857997:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788748236.858056:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788748236.858104:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788748236.858149:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788748236.858180:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788748236.858212:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996992:0@lo:502: 00000100:00100000:2.0:1788748236.858263:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.858302:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2be1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748236.858330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376996992 00000100:00100000:3.0:1788748236.858337:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376996992 00000100:00100000:3.0:1788748236.858417:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748236.858427:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996992:12345-0@lo:502: 00000100:00100000:3.0:1788748236.858626:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376996992:12345-0@lo:502: Request processed in 200us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748236.858633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748236.858706:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376996992:0@lo:502: 00000040:00080000:2.0:1788748236.858753:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788748236.858760:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788748236.859378:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788748236.859394:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ceecf94d40) 00000020:00000080:3.0:1788748236.859416:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788748236.859488:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ceecff9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788748236.859493:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ceecff9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788748236.859495:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecff9800 3 00010000:00080000:3.0:1788748236.859522:0:6719:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cdc4e19000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748236.861381:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788748236.861619:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788748236.861719:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748236.861735:0:6719:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b377f42a7a7bdba 00000100:00080000:3.0:1788748236.861745:0:6719:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748236.861757:0:6719:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdc4e19000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748236.861796:0:6719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76adf80 x1875638376997120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748236.861840:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788748236.861878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638376997120:0@lo:38: 00000100:00100000:1.0:1788748236.861949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.862194:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997120 00000100:00100000:2.0:1788748236.862204:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997120 00000100:00100000:2.0:1788748236.862244:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748236.862252:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638376997120:12345-0@lo:38: 00010000:00080000:2.0:1788748236.862276:0:5844:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1788748236.862310:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b377f42a7a7bdc1 00000004:00100000:2.0:1788748236.862325:0:5844:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788748236.862358:0:5844:0:(import.c:65:import_set_state_nolock()) ffff99cefd3cc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748236.862414:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875638376997120:12345-0@lo:38: Request processed in 161us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.862421:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788748236.862597:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cef76adf80 x1875638376997120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748236.862606:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748236.862613:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788748236.862620:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788748236.862625:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788748236.862627:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e19000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788748236.862633:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638376997120:0@lo:38: 00000040:00080000:3.0:1788748236.864101:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788748236.864198:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788748236.864235:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748236.864261:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.864274:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788748236.864329:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788748236.864332:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748236.864334:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748236.864335:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748236.864336:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748236.864338:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748236.864345:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748236.864347:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748236.864349:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748236.864351:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748236.864352:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748236.864357:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788748236.864359:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748236.864361:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748236.864363:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748236.864364:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748236.864365:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748236.864367:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748236.864368:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748236.864370:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748236.864371:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748236.864372:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748236.864373:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748236.864402:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788748236.864419:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376997248:0@lo:253: 00000100:00100000:1.0:1788748236.864485:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748236.864523:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997248 00000100:00100000:1.0:1788748236.864529:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748236.864531:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997248 00000100:00100000:1.0:1788748236.864604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748236.864615:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6691:x1875638376997248:12345-0@lo:253: 20000000:01000000:1.0:1788748236.864665:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788748236.864680:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788748236.891306:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748236.891323:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788748236.891346:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788748236.891352:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788748236.891378:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.891398:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.891408:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.891451:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748236.891468:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748236.891483:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638376997376:0@lo:104: 00000100:00100000:0.0:1788748236.891547:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748236.891613:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997376 00000100:00100000:1.0:1788748236.891622:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997376 00000100:00100000:1.0:1788748236.891671:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748236.891674:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd3d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748236.891684:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638376997376:12345-0@lo:104: 00010000:00010000:1.0:1788748236.891698:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.891779:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748236.891786:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638376997376:12345-0@lo:104: Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748236.891793:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748236.891804:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638376997376:0@lo:104: 00010000:00010000:1.0:1788748236.891824:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748236.891828:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.891831:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.891846:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43200 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748236.891850:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.891858:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748236.891866:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748236.891872:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748236.891902:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.894003:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748236.894070:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.894080:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b43200/0x5b377f42a7a7bd20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.894120:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.894123:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748236.894125:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748236.894141:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748236.894159:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638376997504:0@lo:103: 00000100:00100000:1.0:1788748236.894227:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748236.894339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997504 00000100:00100000:2.0:1788748236.894347:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997504 00010000:00010000:2.0:1788748236.894374:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748236.894416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748236.894425:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5229c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3307:x1875638376997504:12345-0@lo:103: 00010000:00010000:2.0:1788748236.894438:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748236.894444:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894456:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bd27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bd20 expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894486:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894494:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748236.894508:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003264672s 00010000:00010000:2.0:1788748236.894512:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894519:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894527:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894545:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894558:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748236.894562:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894570:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894592:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748236.894602:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748236.894652:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5229c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3307:x1875638376997504:12345-0@lo:103: Request processed in 228us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.894660:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748236.894702:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638376997504:0@lo:103: 00010000:00010000:1.0:1788748236.894772:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.894782:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748236.894789:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0031200/0x5b377f42a7a7bdc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748236.909194:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6691:1875638376997248:0@lo:253: 10000000:01000000:1.0:1788748236.909215:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788748236.909220:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748236.909221:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748236.909223:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748236.909224:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748236.909225:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748236.909226:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748236.909228:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748236.909230:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748236.909231:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748236.909233:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748236.909235:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788748236.909251:0:6691:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788748236.909661:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:6691:x1875638376997248:12345-0@lo:253: Request processed in 44398us (44526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748236.909672:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788748236.910882:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788748236.914759:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748236.914949:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748236.915215:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748236.915408:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748236.915584:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748236.915766:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788748236.917462:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788748237.239977:0:6691:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788748237.239985:0:6691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788748237.240043:0:6691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748237.240114:0:6691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748237.240137:0:6691:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788748237.240181:0:6691:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788748237.939065:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748238.958062:0:52:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:0.0:1788748238.958088:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748239.981219:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748240.877091:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748240.877099:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec8720800 from 21 10000000:01000000:0.0:1788748240.877105:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748240.877149:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.877161:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.877172:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748240.877197:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997632:0@lo:101: 00000100:00100000:0.0:1788748240.878134:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.878189:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.878338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997632 00000100:00100000:3.0:1788748240.878347:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997632 00000100:00100000:3.0:1788748240.878400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788748240.878408:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638376997632:12345-0@lo:101: 00010000:00010000:3.0:1788748240.878422:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748240.878438:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bdcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748240.878463:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748240.878475:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748240.878483:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748240.878545:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376997632:12345-0@lo:101: Request processed in 137us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.878551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788748240.878635:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997632:0@lo:101: 00010000:00010000:2.0:1788748240.878652:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.878662:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748240.878717:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997760:0@lo:501: 00000100:00100000:2.0:1788748240.878742:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748240.878763:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef74643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.878790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997760 00000100:00100000:3.0:1788748240.878796:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997760 00000100:00100000:3.0:1788748240.878847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748240.878855:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376997760:12345-0@lo:501: 00000100:00100000:3.0:1788748240.879155:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376997760:12345-0@lo:501: Request processed in 299us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.879167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748240.879325:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997760:0@lo:501: 00000100:00100000:0.0:1788748240.879359:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997888:0@lo:503: 00000100:00100000:0.0:1788748240.879395:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.879431:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.879484:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376997888 00000100:00100000:3.0:1788748240.879489:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376997888 00000100:00100000:0.0:1788748240.881521:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748240.881542:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376997888:12345-0@lo:503: 00000100:00100000:0.0:1788748240.881898:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376997888:12345-0@lo:503: Request processed in 363us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748240.881906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748240.881944:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376997888:0@lo:503: 00000100:00100000:2.0:1788748240.882859:0:6918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6918:1875638376998016:0@lo:502: 00000100:00100000:2.0:1788748240.882910:0:6918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748240.882949:0:6918:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.882999:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998016 00000100:00100000:3.0:1788748240.883005:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998016 00000100:00100000:3.0:1788748240.883377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788748240.883396:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6918:x1875638376998016:12345-0@lo:502: 00000100:00100000:3.0:1788748240.883615:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6918:x1875638376998016:12345-0@lo:502: Request processed in 229us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.883623:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748240.884081:0:6918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6918:1875638376998016:0@lo:502: 00000100:00100000:0.0:1788748240.884138:0:6918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6918:1875638376998144:0@lo:502: 00000100:00100000:0.0:1788748240.884173:0:6918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.884210:0:6918:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748240.884268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998144 00000100:00100000:2.0:1788748240.884273:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998144 00000100:00100000:2.0:1788748240.884310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788748240.884319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6918:x1875638376998144:12345-0@lo:502: 00000100:00100000:2.0:1788748240.884457:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:6918:x1875638376998144:12345-0@lo:502: Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748240.884464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788748240.884534:0:6918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6918:1875638376998144:0@lo:502: 00000040:00080000:0.0:1788748240.884552:0:6918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788748240.884729:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788748240.884753:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748240.884762:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.884774:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748240.884784:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748240.884786:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cec8720800 from 4 10000000:01000000:2.0:1788748240.884789:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748240.884812:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.884820:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.884835:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748240.884848:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998272:0@lo:101: 00000100:00100000:2.0:1788748240.884873:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748240.884895:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748240.884940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998272 00000100:00100000:0.0:1788748240.884944:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998272 00000100:00100000:0.0:1788748240.885003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748240.885010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638376998272:12345-0@lo:101: 00010000:00010000:0.0:1788748240.885123:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748240.885137:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bddd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885158:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885169:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885178:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0030600, rc 0) 00000100:00100000:0.0:1788748240.885249:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638376998272:12345-0@lo:101: Request processed in 239us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748240.885261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788748240.885309:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998272:0@lo:101: 00010000:00010000:2.0:1788748240.885322:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.885329:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748240.885369:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998400:0@lo:256: 00000100:00100000:2.0:1788748240.885397:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748240.885458:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.885495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998400 00000100:00100000:3.0:1788748240.885499:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998400 00000100:00100000:3.0:1788748240.885560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748240.885568:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638376998400:12345-0@lo:256: 20000000:01000000:3.0:1788748240.885580:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748240.885597:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748240.885600:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788748240.885750:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638376998400:12345-0@lo:256: Request processed in 182us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.885765:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748240.885810:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998400:0@lo:256: 10000000:01000000:0.0:1788748240.885844:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748240.885849:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885857:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748240.885865:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788748240.885867:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788748240.885869:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788748240.885885:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885893:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.885901:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748240.885912:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998528:0@lo:101: 00000100:00100000:0.0:1788748240.885935:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.886045:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748240.886105:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998528 00000100:00100000:2.0:1788748240.886110:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998528 00000100:00100000:2.0:1788748240.886129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748240.886136:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638376998528:12345-0@lo:101: 00010000:00010000:2.0:1788748240.886143:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748240.886151:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bdeb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.886166:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.886185:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748240.886193:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:2.0:1788748240.886221:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376998528:12345-0@lo:101: Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748240.886228:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788748240.886331:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998528:0@lo:101: 00010000:00010000:0.0:1788748240.886343:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.886359:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748240.886402:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998656:0@lo:501: 00000100:00100000:0.0:1788748240.886426:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.886478:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748240.886508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998656 00000100:00100000:2.0:1788748240.886512:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998656 00000100:00100000:2.0:1788748240.886571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748240.886578:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376998656:12345-0@lo:501: 00000100:00100000:2.0:1788748240.886801:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376998656:12345-0@lo:501: Request processed in 223us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748240.886808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788748240.886941:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998656:0@lo:501: 00000100:00100000:0.0:1788748240.886966:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998784:0@lo:503: 00000100:00100000:0.0:1788748240.886999:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.887122:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed5e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.887148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998784 00000100:00100000:3.0:1788748240.887153:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998784 00000100:00100000:3.0:1788748240.887172:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748240.887178:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376998784:12345-0@lo:503: 00000100:00100000:3.0:1788748240.887394:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376998784:12345-0@lo:503: Request processed in 215us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.887400:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788748240.887519:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376998784:0@lo:503: 00000100:00100000:2.0:1788748240.887877:0:6919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6919:1875638376998912:0@lo:502: 00000100:00100000:2.0:1788748240.887913:0:6919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748240.887966:0:6919:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748240.888002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376998912 00000100:00100000:3.0:1788748240.888007:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376998912 00000100:00100000:0.0:1788748240.888231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788748240.888239:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:6919:x1875638376998912:12345-0@lo:502: 00000100:00100000:0.0:1788748240.888485:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:6919:x1875638376998912:12345-0@lo:502: Request processed in 246us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748240.888493:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748240.888566:0:6919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6919:1875638376998912:0@lo:502: 00000020:01000000:3.0:1788748240.888590:0:6919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748240.888596:0:6919:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788748240.888603:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748240.888605:0:6919:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788748240.888611:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748240.888614:0:6919:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788748240.888635:0:6919:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788748240.888638:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748240.888660:0:6919:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cefb82b380) 00000020:00000080:3.0:1788748240.888679:0:6919:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788748240.888685:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748240.888749:0:6919:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788748240.888755:0:6919:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788748240.888761:0:6919:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7be00 00010000:00080000:3.0:1788748240.888788:0:6919:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cdc4e1a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748240.889007:0:6919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788748240.912320:0:6919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788748240.912345:0:6919:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788748240.912891:0:6919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748240.913220:0:6919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748240.913266:0:6919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788748240.913317:0:6919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788748240.913827:0:6920:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748240.913832:0:6920:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788748240.914462:0:6919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748240.914473:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788748240.914517:0:6919:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788748240.914538:0:6919:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7be07 00000100:00080000:0.0:1788748240.914554:0:6919:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748240.914565:0:6919:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cdc4e1a000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748240.914600:0:6919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76a9c00 x1875638376999040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748240.914625:0:6919:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788748240.914678:0:6919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748240.914682:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748240.914684:0:6919:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788748240.914688:0:6919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748240.914691:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748240.914692:0:6919:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748240.914696:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748240.914698:0:6919:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788748240.914723:0:6919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6919:1875638376999168:0@lo:502: 00000100:00100000:0.0:1788748240.914795:0:6919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.914843:0:6919:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748240.914869:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999168 00000100:00100000:0.0:1788748240.914875:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999168 00000100:00100000:0.0:1788748240.914910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748240.914917:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:6919:x1875638376999168:12345-0@lo:502: 00000100:00100000:0.0:1788748240.915146:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:6919:x1875638376999168:12345-0@lo:502: Request processed in 228us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748240.915154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748240.915216:0:6919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:6919:1875638376999168:0@lo:502: 00000020:01000000:0.0:1788748240.915239:0:6919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748240.915243:0:6919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748240.915244:0:6919:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788748240.915247:0:6919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788748240.915346:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788748240.915366:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788748240.915375:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915385:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748240.915396:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788748240.915398:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cee507b380 from 1 10000000:01000000:0.0:1788748240.915401:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788748240.915423:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915431:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915440:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748240.915450:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376999296:0@lo:101: 00000100:00100000:0.0:1788748240.915474:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.915492:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748240.915504:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999296 00000100:00100000:0.0:1788748240.915507:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999296 00000100:00100000:0.0:1788748240.915523:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788748240.915529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638376999296:12345-0@lo:101: 00010000:00010000:0.0:1788748240.915537:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748240.915547:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915577:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915586:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915594:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031a00, rc 0) 00000100:00100000:0.0:1788748240.915621:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638376999296:12345-0@lo:101: Request processed in 92us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748240.915627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788748240.915653:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376999296:0@lo:101: 00010000:00010000:0.0:1788748240.915664:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.915672:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748240.915706:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376999424:0@lo:501: 00000100:00100000:0.0:1788748240.915726:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748240.915736:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748240.915748:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999424 00000100:00100000:0.0:1788748240.915751:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999424 00000100:00100000:0.0:1788748240.915768:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748240.915774:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638376999424:12345-0@lo:501: 00000100:00100000:0.0:1788748240.915940:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638376999424:12345-0@lo:501: Request processed in 166us (212us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748240.915946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748240.915980:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638376999424:0@lo:501: 10000000:01000000:0.0:1788748240.915996:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788748240.916001:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748240.916008:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748240.917169:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638376999040:0@lo:8: 00000100:00100000:3.0:1788748240.917830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748240.917952:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638376999552:0@lo:400: 00000100:00100000:3.0:1788748240.917979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748240.918049:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638376999680:0@lo:400: 00000100:00100000:3.0:1788748240.918074:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748240.918112:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999552 00000100:00100000:3.0:1788748240.918118:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999552 00000100:00100000:3.0:1788748240.918154:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999680 00000100:00100000:3.0:1788748240.918157:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999680 00000100:00100000:3.0:1788748240.918184:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748240.918192:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638376999552:12345-0@lo:400: 00000100:00100000:3.0:1788748240.918240:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638376999552:12345-0@lo:400: Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.918247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748240.918264:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748240.918270:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638376999680:12345-0@lo:400: 00000100:00100000:3.0:1788748240.918301:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638376999680:12345-0@lo:400: Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748240.918307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788748240.918322:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748240.918348:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76afb80 x1875638376999552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748240.918361:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638376999552:0@lo:400: 00010000:00080000:3.0:1788748240.918387:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76aea00 x1875638376999680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748240.918395:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638376999680:0@lo:400: 00000100:00100000:1.0:1788748240.918573:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999040 00000100:00100000:1.0:1788748240.918582:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999040 00000100:00100000:1.0:1788748240.918613:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748240.918619:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875638376999040:12345-0@lo:8: 00010000:00080000:1.0:1788748240.918640:0:6695:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1788748240.918670:0:6695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7be1c 00002000:00100000:1.0:1788748240.918704:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cefd76b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788748240.918708:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788748240.918711:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788748240.918814:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748240.918930:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748240.918952:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99cefd76d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748240.918991:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638376999040:12345-0@lo:8: Request processed in 372us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748240.918997:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788748240.919062:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76a9c00 x1875638376999040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748240.919071:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748240.919078:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788748240.919085:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748240.919090:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788748240.919092:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e1a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748240.919104:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748240.919108:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638376999040:0@lo:8: 00000004:00080000:1.0:1788748240.919127:0:6920:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748240.919211:0:6920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 157962195708ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788748240.972582:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788748240.999936:0:6921:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788748240.999971:0:6921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638376999936:0@lo:7: 00000100:00100000:2.0:1788748241.000068:0:6921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748241.000115:0:6921:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced123dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748241.000142:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999936 00000100:00100000:2.0:1788748241.000149:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999936 00000100:00100000:2.0:1788748241.000203:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748241.000218:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6921:x1875638376999936:12345-0@lo:7: 00000100:00100000:3.0:1788748241.000632:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748241.000645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638376999808:0@lo:13: 00000100:00100000:3.0:1788748241.000676:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748241.000704:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748241.006171:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638376999808 00000100:00100000:0.0:1788748241.006185:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638376999808 00000100:00100000:0.0:1788748241.006233:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748241.006242:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638376999808:12345-0@lo:13: 00002000:00000024:0.0:1788748241.006274:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788748241.006394:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638376999808:12345-0@lo:13: Request processed in 152us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748241.006403:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748241.006861:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194fb80 x1875638376999808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748241.006886:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638376999808:0@lo:13: 00002000:00080000:2.0:1788748241.010661:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788748241.010670:0:6697:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788748241.010763:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6921:x1875638376999936:12345-0@lo:7: Request processed in 10541us (10690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748241.010773:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748241.010829:0:6921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194e680 x1875638376999936/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748241.010844:0:6921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638376999936:0@lo:7: 00000004:00080000:2.0:1788748241.010857:0:6921:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788748241.010893:0:6921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000064:0@lo:5: 00000100:00100000:2.0:1788748241.010923:0:6921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748241.010971:0:6921:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced123dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748241.011007:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000064 00000100:00100000:2.0:1788748241.011889:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000064 00000100:00100000:2.0:1788748241.011981:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748241.011991:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6921:x1875638377000064:12345-0@lo:5: 00002000:00080000:2.0:1788748241.012051:0:6697:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788748241.012055:0:6697:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788748241.012270:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6921:x1875638377000064:12345-0@lo:5: Request processed in 280us (1345us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788748241.012276:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788748241.012337:0:6921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194e680 x1875638377000064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748241.012350:0:6921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000064:0@lo:5: 00000004:00080000:3.0:1788748241.012359:0:6921:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788748241.012384:0:6921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000192:0@lo:700: 00000100:00100000:3.0:1788748241.012413:0:6921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748241.012432:0:6921:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4b5fc00 going to sleep for 11 seconds 00010000:00010000:0.0:1788748241.013101:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748241.014112:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000192 00000100:00100000:2.0:1788748241.014124:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000192 00000100:00100000:2.0:1788748241.014242:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748241.014252:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6921:x1875638377000192:12345-0@lo:700: 00000100:00100000:2.0:1788748241.014310:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875638377000320:0@lo:700: 00000100:00100000:2.0:1788748241.014375:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748241.014407:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced123d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748241.014426:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000320 00000100:00100000:0.0:1788748241.014433:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000320 00000100:00100000:0.0:1788748241.014474:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748241.014483:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875638377000320:12345-0@lo:700: 40000000:02000000:0.0:1788748241.039211:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788748241.043454:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875638377000320:12345-0@lo:700: Request processed in 28968us (29073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748241.043482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748241.043665:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194c700 x1875638377000320/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788748257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748241.043681:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875638377000320:0@lo:700: 40000000:02000000:3.0:1788748241.043694:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1788748241.074231:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788748241.074247:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788748241.074411:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6921:x1875638377000192:12345-0@lo:700: Request processed in 60157us (61994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748241.074430:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748241.074959:0:6921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76afb80 x1875638377000192/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748241.074972:0:6921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788748241.074993:0:6921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000192:0@lo:700: 00000004:02000040:3.0:1788748241.088776:0:6921:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788748241.091804:0:6921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000448:0@lo:5: 00000100:00100000:3.0:1788748241.091873:0:6921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748241.091991:0:6921:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4b5fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748241.092267:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000448 00000100:00100000:2.0:1788748241.092274:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000448 00000100:00100000:2.0:1788748241.092362:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748241.092374:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6921:x1875638377000448:12345-0@lo:5: 00002000:00080000:2.0:1788748241.096683:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788748241.096705:0:6696:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788748241.099430:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6921:x1875638377000448:12345-0@lo:5: Request processed in 7053us (7551us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788748241.099442:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788748241.099549:0:6921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76afb80 x1875638377000448/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748241.099566:0:6921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6921:1875638377000448:0@lo:5: 00000004:00080000:3.0:1788748241.099581:0:6921:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788748242.030464:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748242.269207:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788748243.053344:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748244.077185:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748245.105310:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748246.126889:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748246.254306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377000576:0@lo:400: 00000100:00100000:2.0:1788748246.254405:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748246.254500:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748246.254516:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377000704:0@lo:400: 00000100:00100000:2.0:1788748246.254561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748246.254593:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377000832:0@lo:400: 00000100:00100000:2.0:1788748246.254641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748246.254676:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748246.254691:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377000960:0@lo:400: 00000100:00100000:2.0:1788748246.254734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748246.254736:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000576 00000100:00100000:3.0:1788748246.254746:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000576 00000100:00100000:2.0:1788748246.254913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000704 00000100:00100000:2.0:1788748246.254919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000704 00000100:00100000:2.0:1788748246.254972:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000832 00000100:00100000:2.0:1788748246.254976:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000832 00000100:00100000:2.0:1788748246.255062:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748246.255072:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377000704:12345-0@lo:400: 00000100:00100000:2.0:1788748246.255160:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377000704:12345-0@lo:400: Request processed in 89us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748246.255168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748246.255199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748246.255219:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377000832:12345-0@lo:400: 00000100:00100000:2.0:1788748246.255262:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377000832:12345-0@lo:400: Request processed in 45us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748246.255280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748246.255598:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377000960 00000100:00100000:2.0:1788748246.255604:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377000960 00000100:00100000:2.0:1788748246.255657:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748246.255664:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377000960:12345-0@lo:400: 00000100:00100000:2.0:1788748246.255722:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377000960:12345-0@lo:400: Request processed in 58us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748246.255728:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788748246.255766:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748246.255782:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748246.256382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748246.256409:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377001088:0@lo:13: 00000100:00100000:2.0:1788748246.256469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748246.256535:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001088 00000100:00100000:2.0:1788748246.256540:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001088 00000100:00100000:2.0:1788748246.256595:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748246.256603:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377001088:12345-0@lo:13: 00002000:00000024:2.0:1788748246.256638:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748246.256707:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377001088:12345-0@lo:13: Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748246.258414:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748246.258661:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cee50e0a80 x1875638377001088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748246.258695:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377001088:0@lo:13: 00010000:00080000:2.0:1788748246.258761:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194fb80 x1875638377000960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748246.258785:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377000960:0@lo:400: 00010000:00080000:2.0:1788748246.258807:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194c700 x1875638377000832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748246.258816:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377000832:0@lo:400: 00000100:00100000:3.0:1788748246.259588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748246.259602:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377000576:12345-0@lo:400: 00010000:00080000:2.0:1788748246.263118:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194e680 x1875638377000704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748246.263146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377000704:0@lo:400: 00000100:00100000:3.0:1788748246.267853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377000576:12345-0@lo:400: Request processed in 8248us (13440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748246.267867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748246.267954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377000576:0@lo:400: 00000001:00080000:2.0:1788748246.350927:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788748247.151105:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748248.174228:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748249.205338:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748250.221225:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748251.252378:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748251.373984:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377001216:0@lo:13: 00000100:00100000:1.0:1788748251.374074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748251.374162:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001216 00000100:00100000:1.0:1788748251.374170:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001216 00000100:00100000:1.0:1788748251.374234:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748251.374243:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377001216:12345-0@lo:13: 00002000:00000024:1.0:1788748251.374275:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748251.374320:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377001216:12345-0@lo:13: Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748251.374327:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788748251.374350:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788748251.374381:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cee50e2a00 x1875638377001216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748251.374391:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788748251.374412:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377001216:0@lo:13: 00000100:00100000:0.0:1788748251.376322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377001344:0@lo:400: 00000100:00100000:0.0:1788748251.376385:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748251.376429:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748251.376437:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377001472:0@lo:400: 00000100:00100000:0.0:1788748251.376463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748251.376532:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001344 00000100:00100000:0.0:1788748251.376539:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001344 00000100:00100000:0.0:1788748251.377664:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788748251.377674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001472 00000100:00100000:0.0:1788748251.377678:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3308:x1875638377001344:12345-0@lo:400: 00000100:00100000:2.0:1788748251.377682:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001472 00000100:00100000:2.0:1788748251.377723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748251.377732:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377001472:12345-0@lo:400: 00000100:00100000:0.0:1788748251.377754:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3308:x1875638377001344:12345-0@lo:400: Request processed in 79us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748251.377761:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788748251.377779:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377001472:12345-0@lo:400: Request processed in 47us (1313us total) trans 0 rc 0/0 00010000:00080000:0.0:1788748251.377813:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76aa680 x1875638377001472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748251.377827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377001472:0@lo:400: 00000100:00100000:0.0:1788748251.377837:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377001344:0@lo:400: 00000100:00100000:2.0:1788748251.377930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748251.378055:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748251.378068:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377001600:0@lo:400: 00000100:00100000:1.0:1788748251.378102:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748251.378143:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001600 00000100:00100000:1.0:1788748251.378148:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001600 00000100:00100000:1.0:1788748251.378184:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748251.378192:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377001600:12345-0@lo:400: 00000100:00100000:1.0:1788748251.378228:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377001600:12345-0@lo:400: Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748251.378242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788748251.378381:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788748251.378409:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76a8000 x1875638377001600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748251.378419:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377001600:0@lo:400: 00010000:00010000:3.0:1788748252.279738:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748253.241821:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748253.241825:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788748253.241978:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ceecebd000 00000020:01000004:2.0:1788748253.241998:0:7631:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788748253.242058:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788748253.242072:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ceece74d40) 00000020:00000080:2.0:1788748253.242088:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788748253.255688:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788748253.255962:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788748253.273904:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788748253.278587:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788748253.278619:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788748253.278672:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788748253.278716:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788748253.279077:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788748253.279087:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788748253.279098:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7be2a 00000020:01000004:3.0:1788748253.279105:0:7631:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788748253.279124:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788748253.279126:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788748253.279132:0:7631:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788748253.279150:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788748253.279154:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1788748253.293301:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788748253.294375:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748253.294409:0:7631:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788748253.294414:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748253.294416:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748253.294417:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748253.294418:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748253.294419:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748253.294421:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748253.294422:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748253.294492:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748253.294494:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748253.294496:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748253.294497:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748253.294502:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788748253.294504:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748253.294505:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748253.294506:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748253.294507:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748253.294508:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748253.294509:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748253.294510:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748253.294511:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748253.294512:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748253.294513:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748253.294514:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748253.294547:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788748253.294569:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377001728:0@lo:253: 00000100:00100000:3.0:1788748253.294636:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.294748:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.294946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001728 00000100:00100000:0.0:1788748253.294965:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001728 00000100:00100000:0.0:1788748253.295102:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748253.295113:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:7631:x1875638377001728:12345-0@lo:253: 20000000:01000000:0.0:1788748253.295152:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788748253.295155:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788748253.295161:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788748253.295163:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788748253.296102:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748253.296297:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788748253.296313:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788748253.296349:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788748253.296359:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788748253.296387:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788748253.296436:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788748253.296761:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788748253.296779:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788748253.296781:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788748253.296809:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788748253.296817:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788748253.296854:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788748253.296861:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788748253.296886:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788748253.296895:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748253.296918:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788748253.296971:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788748253.297626:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788748253.297643:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788748253.297645:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788748253.297672:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788748253.297679:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788748253.297703:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788748253.297709:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788748253.297732:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788748253.297740:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748253.297790:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788748253.297825:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788748253.297839:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788748253.297841:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788748253.297844:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788748253.297859:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788748253.297862:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788748253.297892:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788748253.297894:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788748253.298789:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788748253.298860:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788748253.298913:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788748253.299292:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788748253.299337:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788748253.299411:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788748253.299493:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788748253.299496:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788748253.299904:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788748253.299947:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788748253.300012:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788748253.300363:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788748253.300401:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788748253.300448:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788748253.300461:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788748253.300463:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788748253.300892:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788748253.300949:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788748253.301049:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788748253.301286:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788748253.301324:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788748253.301379:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788748253.301393:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788748253.301395:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788748253.301860:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788748253.302182:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788748253.302221:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788748253.302276:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788748253.302293:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788748253.302294:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788748253.302302:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788748253.302320:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302337:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302344:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302367:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302373:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302380:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302388:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302522:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302539:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 16 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.302554:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377001856:0@lo:104: 00000100:00100000:0.0:1788748253.302620:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748253.302714:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302723:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.302732:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377001984:0@lo:104: 00010000:00010000:0.0:1788748253.302758:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302776:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.302786:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002112:0@lo:104: 00010000:00010000:0.0:1788748253.302813:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302821:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.302829:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002240:0@lo:104: 00010000:00010000:0.0:1788748253.302849:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.302856:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.302863:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002368:0@lo:104: 00000100:00100000:0.0:1788748253.302879:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748253.305209:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788748253.305250:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.305330:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.305676:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.305697:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001856 00000100:00100000:0.0:1788748253.305706:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001856 00000100:00100000:0.0:1788748253.305748:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377001984 00000100:00100000:0.0:1788748253.305750:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377001984 00000100:00100000:0.0:1788748253.305759:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002112 00000100:00100000:0.0:1788748253.305761:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002112 00000100:00100000:0.0:1788748253.305772:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748253.305782:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed668850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5838:x1875638377001856:12345-0@lo:104: 00010000:00010000:0.0:1788748253.305799:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.305925:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748253.305932:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed668850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5838:x1875638377001856:12345-0@lo:104: Request processed in 152us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.305939:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748253.305993:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748253.306000:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638377001984:12345-0@lo:104: 00010000:00010000:0.0:1788748253.306008:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.306129:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377001856:0@lo:104: 00000100:00100000:3.0:1788748253.306140:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377001984:0@lo:104: 00010000:00010000:2.0:1788748253.306191:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748253.306198:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306206:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748253.306210:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306217:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748253.306224:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748253.306229:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748253.306271:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306279:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748253.306305:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306312:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec0031200/0x5b377f42a7a7be0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306325:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748253.306327:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306333:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748253.306336:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306341:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748253.306346:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748253.306351:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748253.306364:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306369:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748253.306383:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306389:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec0031000/0x5b377f42a7a7bdeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdf2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.306398:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.306405:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.306407:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748253.306547:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.306555:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788748253.306562:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788748253.306588:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377002496:0@lo:103: 00000100:00100000:1.0:1788748253.306635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.306743:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002496 00000100:00100000:3.0:1788748253.306749:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002496 00010000:00010000:3.0:1788748253.306771:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.306794:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748253.306801:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3307:x1875638377002496:12345-0@lo:103: 00010000:00010000:3.0:1788748253.306812:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748253.306817:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.306827:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.306842:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7be15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7be0e expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.306855:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748253.306885:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3307:x1875638377002496:12345-0@lo:103: Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748253.306903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748253.306989:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377002496:0@lo:103: 00000100:00100000:1.0:1788748253.307334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377002624:0@lo:103: 00000100:00100000:1.0:1788748253.307361:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.307404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002624 00000100:00100000:1.0:1788748253.307408:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002624 00010000:00010000:1.0:1788748253.307513:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748253.307543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748253.307551:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3308:x1875638377002624:12345-0@lo:103: 00010000:00010000:1.0:1788748253.307560:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748253.307564:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.307584:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.307595:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147c200/0x5b377f42a7a7bdf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bdeb expref: 16 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.307606:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748253.307634:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3308:x1875638377002624:12345-0@lo:103: Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748253.307640:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748253.307667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377002624:0@lo:103: 00010000:00010000:0.0:1788748253.307881:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788748253.307889:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638377001984:12345-0@lo:104: Request processed in 1890us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.307896:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748253.307911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002240 00000100:00100000:0.0:1788748253.307915:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002240 00000100:00100000:0.0:1788748253.307928:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002368 00000100:00100000:0.0:1788748253.307930:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002368 00000100:00100000:0.0:1788748253.307939:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748253.307944:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5838:x1875638377002112:12345-0@lo:104: 00010000:00010000:0.0:1788748253.307966:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308035:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748253.308040:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:5838:x1875638377002112:12345-0@lo:104: Request processed in 96us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.308045:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748253.308057:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748253.308068:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638377002240:12345-0@lo:104: 00010000:00010000:0.0:1788748253.308076:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308107:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788748253.308112:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:5838:x1875638377002240:12345-0@lo:104: Request processed in 45us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.308117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748253.308129:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748253.308134:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638377002368:12345-0@lo:104: 00010000:00010000:0.0:1788748253.308141:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308166:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788748253.308171:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5838:x1875638377002368:12345-0@lo:104: Request processed in 38us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.308176:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788748253.308195:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748253.308200:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308207:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748253.308210:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308217:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748253.308222:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748253.308234:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788748253.308298:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002112:0@lo:104: 00000100:00100000:1.0:1788748253.308307:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002240:0@lo:104: 00000100:00100000:1.0:1788748253.308313:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875638377002368:0@lo:104: 00010000:00010000:1.0:1788748253.308336:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.308450:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748253.308456:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.308463:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748253.308465:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.308472:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748253.308478:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748253.308484:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748253.308800:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308808:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748253.308833:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec0030a00/0x5b377f42a7a7bdcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdd6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308853:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748253.308856:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308862:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748253.308864:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.308870:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748253.308876:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748253.308880:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788748253.308915:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377002752:0@lo:103: 00000100:00100000:1.0:1788748253.308949:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.309002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002752 00000100:00100000:1.0:1788748253.309007:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002752 00010000:00010000:1.0:1788748253.309043:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 15 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748253.309065:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748253.309072:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3309:x1875638377002752:12345-0@lo:103: 00010000:00010000:1.0:1788748253.309090:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748253.309095:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 15 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.309104:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 15 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.309116:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bdd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bdcf expref: 15 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.309141:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748253.309168:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3309:x1875638377002752:12345-0@lo:103: Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748253.309174:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748253.309202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377002752:0@lo:103: 00010000:00010000:2.0:1788748253.309379:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309387:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748253.309409:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309415:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02056c00/0x5b377f42a7a7bda5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bdac expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309434:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.309436:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.309438:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748253.309525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377002880:0@lo:103: 00000100:00100000:1.0:1788748253.309551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.309632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377002880 00000100:00100000:2.0:1788748253.309644:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377002880 00010000:00010000:2.0:1788748253.309662:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748253.309691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748253.309698:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3306:x1875638377002880:12345-0@lo:103: 00010000:00010000:2.0:1788748253.309706:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748253.309710:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309719:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309730:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7bdac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bda5 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.309740:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748253.309768:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638377002880:12345-0@lo:103: Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748253.309774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748253.309831:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377002880:0@lo:103: 00010000:00010000:0.0:1788748253.309939:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.309946:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788748253.309999:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377003008:0@lo:103: 00000100:00100000:2.0:1788748253.310044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748253.310133:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.310140:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02056600/0x5b377f42a7a7bd7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd82 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.310153:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748253.310154:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748253.310156:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748253.310166:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748253.310217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003008 00000100:00100000:1.0:1788748253.310222:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003008 00010000:00010000:1.0:1788748253.310238:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 13 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748253.310265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748253.310272:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3307:x1875638377003008:12345-0@lo:103: 00010000:00010000:1.0:1788748253.310280:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748253.310283:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 13 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310298:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 13 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310309:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bd82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bd7b expref: 13 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310322:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310330:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310342:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310348:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310354:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310361:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310366:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748253.310370:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310377:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310404:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310415:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748253.310612:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3307:x1875638377003008:12345-0@lo:103: Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748253.310619:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788748253.310640:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310648:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.310654:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748253.310667:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788748253.311394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377003008:0@lo:103: 00000100:00100000:0.0:1788748253.343818:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:7631:x1875638377001728:12345-0@lo:253: Request processed in 48698us (49172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.343832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748253.343921:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377001728:0@lo:253: 10000000:01000000:3.0:1788748253.343937:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788748253.343940:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748253.343942:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748253.343944:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748253.343945:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788748253.343947:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748253.343948:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748253.343960:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748253.343962:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788748253.343964:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748253.343965:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788748253.343985:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ceecebd000 from lustre-OST0001 10000000:01000000:3.0:1788748253.344008:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788748253.344011:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788748253.344089:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cee507b380 local copy 10000000:01000000:3.0:1788748253.344094:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748253.344129:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.344139:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.344150:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.344167:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003136:0@lo:101: 00000100:00100000:3.0:1788748253.344204:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.344292:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.344364:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003136 00000100:00100000:0.0:1788748253.344371:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003136 00000100:00100000:0.0:1788748253.344409:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748253.344418:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+11:7631:x1875638377003136:12345-0@lo:101: 00010000:00010000:0.0:1788748253.344528:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748253.344543:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be38 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.344566:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be38 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.344576:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be38 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.344584:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5e00, rc 0) 00000100:00100000:0.0:1788748253.344664:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003136:12345-0@lo:101: Request processed in 247us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.344686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748253.344745:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003136:0@lo:101: 00010000:00010000:3.0:1788748253.344767:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.344776:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.344876:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003264:0@lo:501: 00000100:00100000:3.0:1788748253.344900:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.344966:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.345006:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003264 00000100:00100000:0.0:1788748253.345010:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003264 00000100:00100000:0.0:1788748253.345054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748253.345061:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003264:12345-0@lo:501: 00000100:00100000:0.0:1788748253.345290:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003264:12345-0@lo:501: Request processed in 228us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748253.345298:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788748253.345385:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003264:0@lo:501: 10000000:01000000:3.0:1788748253.345399:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788748253.345433:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788748253.345440:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.345450:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.345458:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.345512:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788748253.345532:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ceecebd000 10000000:01000000:3.0:1788748253.345536:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788748253.345541:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788748253.345543:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748253.345547:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788748253.345549:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788748253.345574:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.345581:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748253.345588:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.345600:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003392:0@lo:101: 00000100:00100000:3.0:1788748253.345625:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.345653:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed6616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.345762:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003392 00000100:00100000:0.0:1788748253.345767:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003392 00000100:00100000:0.0:1788748253.345797:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748253.345805:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003392:12345-0@lo:101: 00010000:00010000:0.0:1788748253.345813:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748253.345823:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be46 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.345839:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.345848:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.345856:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748253.345894:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377003392:12345-0@lo:101: Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.345901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748253.345985:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003392:0@lo:101: 00010000:00010000:1.0:1788748253.345996:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.346005:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748253.346093:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003520:0@lo:501: 00000100:00100000:1.0:1788748253.346119:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.346137:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.346192:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003520 00000100:00100000:0.0:1788748253.346197:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003520 00000100:00100000:0.0:1788748253.346236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748253.346243:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377003520:12345-0@lo:501: 00000100:00100000:0.0:1788748253.346396:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377003520:12345-0@lo:501: Request processed in 153us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.346404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788748253.346578:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003520:0@lo:501: 00000100:00100000:1.0:1788748253.346614:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003648:0@lo:503: 00000100:00100000:1.0:1788748253.346652:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.346674:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.346726:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003648 00000100:00100000:0.0:1788748253.346731:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003648 00000100:00100000:0.0:1788748253.346759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748253.346765:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377003648:12345-0@lo:503: 00000100:00100000:0.0:1788748253.346982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377003648:12345-0@lo:503: Request processed in 215us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.346989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1788748253.347083:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748253.347092:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347101:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748253.347105:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347120:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748253.347128:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748253.347134:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748253.347154:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347160:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748253.347183:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347190:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b43600/0x5b377f42a7a7be38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b377f42a7a7be3f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347204:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.347205:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.347207:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748253.347247:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748253.347259:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377003776:0@lo:103: 00000100:00100000:3.0:1788748253.347289:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.347392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003776 00000100:00100000:2.0:1788748253.347397:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003776 00000100:00100000:2.0:1788748253.347442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748253.347450:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3309:x1875638377003776:12345-0@lo:103: 00010000:00010000:2.0:1788748253.347460:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748253.347473:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7be3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7be38 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.347485:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748253.347660:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:3309:x1875638377003776:12345-0@lo:103: Request processed in 210us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748253.347667:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748253.347731:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003648:0@lo:503: 00000100:00100000:3.0:1788748253.348159:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377003776:0@lo:103: 00000040:00080000:1.0:1788748253.348245:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748253.348308:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003904:0@lo:502: 00000100:00100000:1.0:1788748253.348352:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.348421:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.348529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377003904 00000100:00100000:0.0:1788748253.348533:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377003904 00000100:00100000:0.0:1788748253.348603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748253.348612:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003904:12345-0@lo:502: 00000100:00100000:0.0:1788748253.348822:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377003904:12345-0@lo:502: Request processed in 211us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.348830:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788748253.348907:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377003904:0@lo:502: 00000040:00080000:1.0:1788748253.349262:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788748253.349314:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788748253.349349:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788748253.349398:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788748253.349509:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788748253.349549:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788748253.349579:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004032:0@lo:502: 00000100:00100000:1.0:1788748253.349620:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.349688:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.349756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004032 00000100:00100000:0.0:1788748253.349761:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004032 00000100:00100000:0.0:1788748253.349830:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748253.349838:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377004032:12345-0@lo:502: 00000100:00100000:0.0:1788748253.349993:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377004032:12345-0@lo:502: Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.350001:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788748253.350088:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004032:0@lo:502: 00000040:00080000:1.0:1788748253.350172:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788748253.350182:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788748253.350527:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748253.350537:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788748253.350544:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748253.350547:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788748253.350551:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748253.350566:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99cdc4e219c0) 00000020:00000080:1.0:1788748253.350600:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788748253.350607:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748253.350670:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ceecebd000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788748253.350678:0:7639:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748253.350685:0:7639:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7be5b 00010000:00010000:1.0:1788748253.354190:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788748253.354548:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788748253.356924:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788748253.357613:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788748253.361171:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788748253.361698:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788748253.363265:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788748253.363276:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748253.363282:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748253.363284:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788748253.363290:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748253.363294:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748253.363295:0:7639:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788748253.363298:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788748253.363300:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788748253.363345:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748253.363348:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748253.363349:0:7639:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788748253.363352:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788748253.364000:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788748253.364162:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788748253.364227:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.364242:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748253.364250:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecebd000 from 1 10000000:01000000:1.0:1788748253.364253:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748253.364291:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.364299:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748253.364309:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748253.364332:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004160:0@lo:101: 00000100:00100000:1.0:1788748253.364400:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748253.364448:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748253.364569:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004160 00000100:00100000:2.0:1788748253.364577:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004160 00000100:00100000:2.0:1788748253.364617:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788748253.364626:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:7631:x1875638377004160:12345-0@lo:101: 00010000:00010000:2.0:1788748253.364638:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748253.364651:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be62 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.364673:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.364683:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.364690:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147ce00, rc 0) 00000100:00100000:2.0:1788748253.364732:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004160:12345-0@lo:101: Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748253.364744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748253.364749:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004160:0@lo:101: 00010000:00010000:0.0:1788748253.364768:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.364777:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.364866:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004288:0@lo:501: 00000100:00100000:0.0:1788748253.364893:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.364917:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748253.365468:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004288 00000100:00100000:2.0:1788748253.365474:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004288 00000100:00100000:2.0:1788748253.365510:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788748253.365518:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004288:12345-0@lo:501: 00000100:00100000:2.0:1788748253.365721:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004288:12345-0@lo:501: Request processed in 204us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748253.365726:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748253.365789:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004288:0@lo:501: 00000100:00100000:0.0:1788748253.365821:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004416:0@lo:503: 00000100:00100000:0.0:1788748253.365859:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.365887:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748253.365929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004416 00000100:00100000:2.0:1788748253.365932:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004416 00000100:00100000:2.0:1788748253.365972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748253.365979:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004416:12345-0@lo:503: 00000100:00100000:2.0:1788748253.366284:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004416:12345-0@lo:503: Request processed in 305us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748253.366291:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788748253.366466:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004416:0@lo:503: 00000040:00080000:3.0:1788748253.366718:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748253.366779:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004544:0@lo:502: 00000100:00100000:3.0:1788748253.366818:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.366852:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.366917:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004544 00000100:00100000:0.0:1788748253.366922:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004544 00000100:00100000:0.0:1788748253.366995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788748253.367003:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004544:12345-0@lo:502: 00000100:00100000:0.0:1788748253.367178:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004544:12345-0@lo:502: Request processed in 175us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.367185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788748253.367303:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004544:0@lo:502: 00000040:00080000:3.0:1788748253.367535:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788748253.367585:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788748253.367608:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004672:0@lo:502: 00000100:00100000:3.0:1788748253.367642:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748253.367674:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.367733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004672 00000100:00100000:0.0:1788748253.367737:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004672 00000100:00100000:0.0:1788748253.367974:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788748253.367983:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004672:12345-0@lo:502: 00000100:00100000:0.0:1788748253.368142:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004672:12345-0@lo:502: Request processed in 160us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.368149:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788748253.368222:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004672:0@lo:502: 00000040:00080000:3.0:1788748253.368296:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788748253.368305:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788748253.369272:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748253.369281:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748253.369284:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788748253.369290:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ceecebd000 00000020:00000080:0.0:1788748253.369292:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748253.369308:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748253.369311:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748253.369312:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788748253.369315:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788748253.369568:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788748253.369589:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748253.369607:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.369619:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748253.369658:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788748253.369660:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ceecebd000 10000000:01000000:2.0:1788748253.369663:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ceecebd000 10000000:01000000:2.0:1788748253.369667:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748253.369672:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ceecebd000 from 1 10000000:01000000:2.0:1788748253.369679:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788748253.369712:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.369720:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.369729:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748253.369745:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004800:0@lo:101: 00000100:00100000:2.0:1788748253.370008:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.370171:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.370216:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004800 00000100:00100000:0.0:1788748253.370222:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004800 00000100:00100000:0.0:1788748253.370287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788748253.370296:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377004800:12345-0@lo:101: 00010000:00010000:0.0:1788748253.370313:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748253.370325:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be70 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.370346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.370358:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.370366:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4000, rc 0) 00000100:00100000:0.0:1788748253.370403:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377004800:12345-0@lo:101: Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.370409:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788748253.370430:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004800:0@lo:101: 00010000:00010000:2.0:1788748253.370443:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.370452:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748253.370536:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004928:0@lo:501: 00000100:00100000:2.0:1788748253.370560:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.370614:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.370620:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377004928 00000100:00100000:0.0:1788748253.370624:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377004928 00000100:00100000:0.0:1788748253.370655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788748253.370661:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377004928:12345-0@lo:501: 00000100:00100000:0.0:1788748253.370868:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377004928:12345-0@lo:501: Request processed in 206us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.370875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788748253.370886:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377004928:0@lo:501: 00000100:00100000:2.0:1788748253.370910:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005056:0@lo:503: 00000100:00100000:2.0:1788748253.370944:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.370974:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.371053:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005056 00000100:00100000:0.0:1788748253.371057:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005056 00000100:00100000:0.0:1788748253.371081:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788748253.371088:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005056:12345-0@lo:503: 00000100:00100000:0.0:1788748253.371225:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005056:12345-0@lo:503: Request processed in 136us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.371232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788748253.371254:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005056:0@lo:503: 00000040:00080000:2.0:1788748253.371507:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748253.371571:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005184:0@lo:502: 00000100:00100000:2.0:1788748253.371610:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.371638:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.371684:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005184 00000100:00100000:0.0:1788748253.371688:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005184 00000100:00100000:0.0:1788748253.371757:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788748253.371764:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005184:12345-0@lo:502: 00000100:00100000:0.0:1788748253.371920:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005184:12345-0@lo:502: Request processed in 156us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.371927:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788748253.371976:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005184:0@lo:502: 00000040:00080000:2.0:1788748253.372243:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788748253.372288:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788748253.372324:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788748253.372372:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788748253.372408:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788748253.372595:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788748253.372640:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788748253.372676:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788748253.372722:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788748253.372851:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788748253.372884:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788748253.372930:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788748253.373330:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788748253.373366:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788748253.373414:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788748253.373599:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788748253.373636:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788748253.373698:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788748253.373813:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788748253.373889:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788748253.373927:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788748253.373945:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788748253.373987:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788748253.374058:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788748253.374096:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788748253.374144:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788748253.374195:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788748253.374232:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788748253.374266:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788748253.374312:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788748253.374349:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788748253.374400:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788748253.375169:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788748253.375249:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788748253.375290:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788748253.375338:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788748253.375374:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788748253.375564:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005312:0@lo:502: 00000100:00100000:2.0:1788748253.375642:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.375693:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.375816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005312 00000100:00100000:0.0:1788748253.375835:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005312 00000100:00100000:0.0:1788748253.375895:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788748253.375904:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005312:12345-0@lo:502: 00000100:00100000:0.0:1788748253.376870:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377005312:12345-0@lo:502: Request processed in 964us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.376880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788748253.377222:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377005312:0@lo:502: 00000040:00080000:2.0:1788748253.377312:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788748253.377326:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788748253.378267:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788748253.378282:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ceece719c0) 00000020:00000080:2.0:1788748253.378304:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788748253.378387:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ceecebd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748253.378392:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ceecebd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748253.378394:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecebd000 3 00010000:00080000:2.0:1788748253.378589:0:7644:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ceecebf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788748253.380888:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788748253.381185:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788748253.381224:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748253.381236:0:7644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b377f42a7a7be85 00000100:00080000:2.0:1788748253.381246:0:7644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748253.381264:0:7644:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99ceecebf000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748253.381300:0:7644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cf0194d180 x1875638377005440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748253.381317:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748253.381478:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748253.381493:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377005568:0@lo:400: 00000100:00100000:0.0:1788748253.381562:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.381615:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377005696:0@lo:400: 00000100:00100000:0.0:1788748253.381644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.381665:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748253.381670:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377005824:0@lo:400: 00000100:00100000:0.0:1788748253.381696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.381741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005568 00000100:00100000:0.0:1788748253.381748:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005568 00000100:00100000:0.0:1788748253.381786:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005696 00000100:00100000:0.0:1788748253.381789:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005696 00000100:00100000:0.0:1788748253.381817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748253.381824:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377005568:12345-0@lo:400: 00000100:00100000:0.0:1788748253.381890:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377005568:12345-0@lo:400: Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.381897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748253.381912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748253.381920:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377005696:12345-0@lo:400: 00000100:00100000:0.0:1788748253.381964:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377005696:12345-0@lo:400: Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.381970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748253.381994:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005824 00000100:00100000:0.0:1788748253.381998:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005824 00000100:00100000:0.0:1788748253.382044:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748253.382051:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377005824:12345-0@lo:400: 00000100:00100000:0.0:1788748253.382082:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377005824:12345-0@lo:400: Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.382088:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788748253.382106:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748253.382111:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748253.382249:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76aa680 x1875638377005824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748253.382263:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377005824:0@lo:400: 00010000:00080000:0.0:1788748253.382274:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76a8700 x1875638377005696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748253.382282:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377005696:0@lo:400: 00010000:00080000:0.0:1788748253.382312:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76ab100 x1875638377005568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748253.382320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377005568:0@lo:400: 00000040:00080000:0.0:1788748253.382461:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788748253.382592:0:7645:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff99cef76ab100 x1875638377005952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748253.382601:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d900 going to sleep for 0 seconds 00000100:00100000:1.0:1788748253.382886:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377005440:0@lo:38: 00000100:00100000:1.0:1788748253.382933:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788748253.383242:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788748253.383276:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748253.383300:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748253.383312:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788748253.383371:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788748253.383373:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748253.383375:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748253.383376:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748253.383377:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748253.383379:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748253.383380:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748253.383381:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748253.383383:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748253.383385:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748253.383386:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748253.383390:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788748253.383393:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748253.383394:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748253.383395:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748253.383396:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748253.383397:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748253.383398:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748253.383399:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748253.383400:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748253.383401:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748253.383402:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748253.383403:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748253.383424:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788748253.383433:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377006080:0@lo:253: 00000100:00100000:2.0:1788748253.383479:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748253.383513:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748253.383660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005440 00000100:00100000:0.0:1788748253.383668:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005440 00000100:00100000:0.0:1788748253.383746:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748253.383752:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875638377005440:12345-0@lo:38: 00010000:00080000:0.0:1788748253.383773:0:5845:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1788748253.383805:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b377f42a7a7be8c 00000004:00100000:0.0:1788748253.383818:0:5845:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788748253.383861:0:5845:0:(import.c:65:import_set_state_nolock()) ffff99cefd853000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748253.383920:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875638377005440:12345-0@lo:38: Request processed in 166us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.383927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788748253.383999:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cf0194d180 x1875638377005440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748253.384009:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748253.384037:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788748253.384045:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748253.384049:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748253.384051:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788748253.384057:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e7265b2a): req@ffff99cef76ab100 x1875638377005952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748253.384072:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377005440:0@lo:38: 00000100:00100000:1.0:1788748253.389175:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006080 00000100:00100000:1.0:1788748253.389195:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006080 00000100:00100000:1.0:1788748253.389259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788748253.389269:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:7631:x1875638377006080:12345-0@lo:253: 20000000:01000000:1.0:1788748253.389305:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788748253.389319:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788748253.390375:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.390432:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377005952 00000100:00100000:0.0:1788748253.390438:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377005952 00000100:00100000:0.0:1788748253.390484:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748253.390494:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875638377005952:12345-0@lo:901: 00000100:00100000:0.0:1788748253.390846:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875638377005952:12345-0@lo:901: Request processed in 353us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.390855:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788748253.390879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748253.390912:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76ab100 x1875638377005952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788748269 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748253.390928:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875638377005952:0@lo:901: 20000000:01000000:2.0:1788748253.425565:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788748253.425683:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788748253.426637:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788748253.426644:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788748253.426666:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.426683:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.426769:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.426811:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.426826:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 14 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.426840:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638377006208:0@lo:104: 00000100:00100000:0.0:1788748253.426902:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.427040:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748253.427188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006208 00000100:00100000:1.0:1788748253.427197:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006208 00000100:00100000:0.0:1788748253.427367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748253.427377:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638377006208:12345-0@lo:104: 00010000:00010000:0.0:1788748253.427390:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427560:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748253.427567:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:5860:x1875638377006208:12345-0@lo:104: Request processed in 192us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.427574:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748253.427646:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875638377006208:0@lo:104: 00010000:00010000:2.0:1788748253.427666:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427783:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748253.427789:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427797:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748253.427800:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427808:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748253.427815:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748253.427821:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748253.427894:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427901:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748253.427928:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427944:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bddd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bde4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.427971:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748253.427973:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748253.427974:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748253.427983:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748253.427995:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377006336:0@lo:103: 00000100:00100000:0.0:1788748253.428059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748253.428094:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006336 00000100:00100000:0.0:1788748253.428109:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006336 00010000:00010000:0.0:1788748253.428128:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748253.428151:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748253.428159:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee522a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3309:x1875638377006336:12345-0@lo:103: 00010000:00010000:0.0:1788748253.428169:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748253.428174:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428184:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428198:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0030600/0x5b377f42a7a7bde4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bddd expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428213:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428231:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788748253.428245:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003264672s 00010000:00010000:0.0:1788748253.428249:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428255:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428261:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428266:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428271:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748253.428274:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428281:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428293:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428300:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748253.428327:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee522a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3309:x1875638377006336:12345-0@lo:103: Request processed in 170us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748253.428333:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748253.428612:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377006336:0@lo:103: 00010000:00010000:0.0:1788748253.428631:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428639:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748253.428645:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4e00/0x5b377f42a7a7be93 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748253.436074:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:7631:x1875638377006080:12345-0@lo:253: Request processed in 46793us (52581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748253.436090:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788748253.436209:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e30aac72-4ae1-4e90-ba43-18115a48a5f4:7631:1875638377006080:0@lo:253: 10000000:01000000:2.0:1788748253.436229:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788748253.436233:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748253.436234:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748253.436236:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748253.436237:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748253.436238:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748253.436240:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748253.436241:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748253.436258:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748253.436259:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748253.436261:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748253.436262:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788748253.436278:0:7631:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788748253.445265:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748253.445631:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748253.445818:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748253.446009:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748253.446346:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748253.446735:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788748253.449986:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788748253.654722:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788748253.654730:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788748253.654764:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788748253.654820:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788748253.654838:0:7631:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788748253.654865:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788748254.317298:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748255.341169:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748256.365202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748256.494569:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748256.494595:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377006464:0@lo:13: 00000100:00100000:2.0:1788748256.494662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748256.494757:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006464 00000100:00100000:1.0:1788748256.494765:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006464 00000100:00100000:1.0:1788748256.494831:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748256.494840:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377006464:12345-0@lo:13: 00002000:00000024:1.0:1788748256.494871:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748256.494913:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377006464:12345-0@lo:13: Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748256.494919:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788748256.495233:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748256.495272:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e1c00 x1875638377006464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748256.495292:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377006464:0@lo:13: 00010000:00010000:0.0:1788748257.390894:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748258.418483:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748258.542212:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377006592:0@lo:400: 00000100:00100000:3.0:1788748258.542281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.542331:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377007104:0@lo:400: 00000100:00100000:3.0:1788748258.542362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.542392:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748258.542398:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377006720:0@lo:400: 00000100:00100000:3.0:1788748258.542418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.542447:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377006848:0@lo:400: 00000100:00100000:3.0:1788748258.542469:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.542486:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748258.542491:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377006976:0@lo:400: 00000100:00100000:3.0:1788748258.542514:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.542546:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006592 00000100:00100000:3.0:1788748258.542561:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006592 00000100:00100000:3.0:1788748258.542608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748258.542616:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638377006592:12345-0@lo:400: 00000100:00100000:3.0:1788748258.542663:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638377006592:12345-0@lo:400: Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.542671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748258.542703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007104 00000100:00100000:3.0:1788748258.542706:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007104 00000100:00100000:3.0:1788748258.542734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006720 00000100:00100000:3.0:1788748258.542737:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006720 00000100:00100000:3.0:1788748258.542748:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006848 00000100:00100000:3.0:1788748258.542750:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006848 00000100:00100000:3.0:1788748258.542764:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748258.542770:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377007104:12345-0@lo:400: 00000100:00100000:3.0:1788748258.542801:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377007104:12345-0@lo:400: Request processed in 32us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.542808:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748258.542819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748258.542825:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377006720:12345-0@lo:400: 00000100:00100000:3.0:1788748258.542849:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377006720:12345-0@lo:400: Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.542855:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748258.542866:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748258.542872:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377006848:12345-0@lo:400: 00000100:00100000:3.0:1788748258.542901:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377006848:12345-0@lo:400: Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.542907:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748258.542988:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377006976 00000100:00100000:3.0:1788748258.542993:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377006976 00000100:00100000:3.0:1788748258.543039:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748258.543046:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377006976:12345-0@lo:400: 00000100:00100000:3.0:1788748258.543077:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377006976:12345-0@lo:400: Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.543084:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788748258.543102:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748258.543107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748258.543133:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76af480 x1875638377006976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.543147:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377006976:0@lo:400: 00010000:00080000:3.0:1788748258.543158:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ace00 x1875638377006848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.543167:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377006848:0@lo:400: 00010000:00080000:3.0:1788748258.543198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ae300 x1875638377006720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.543206:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377006720:0@lo:400: 00000100:00100000:3.0:1788748258.543214:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377006592:0@lo:400: 00010000:00080000:3.0:1788748258.543223:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76af800 x1875638377007104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.543231:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377007104:0@lo:400: 00010000:00010000:0.0:1788748259.442703:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748259.496826:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788748260.462181:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748260.590872:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788748260.590882:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ceecff9800 from 30 10000000:01000000:3.0:1788748260.590887:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748260.590963:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.590975:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.590987:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748260.591011:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007232:0@lo:101: 00000100:00100000:3.0:1788748260.591135:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.591269:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.592317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007232 00000100:00100000:1.0:1788748260.592329:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007232 00000100:00100000:1.0:1788748260.593924:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788748260.593941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377007232:12345-0@lo:101: 00010000:00010000:1.0:1788748260.593960:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748260.593981:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7be9a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.594062:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.594074:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.594085:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02056600, rc 0) 00000100:00100000:1.0:1788748260.594179:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007232:12345-0@lo:101: Request processed in 243us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.594186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788748260.594254:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007232:0@lo:101: 00010000:00010000:1.0:1788748260.594272:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.594283:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748260.594346:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007360:0@lo:501: 00000100:00100000:1.0:1788748260.594454:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.594501:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788748260.595280:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007360 00000100:00100000:3.0:1788748260.595297:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007360 00000100:00100000:3.0:1788748260.595383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748260.595398:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007360:12345-0@lo:501: 00000100:00100000:3.0:1788748260.596041:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007360:12345-0@lo:501: Request processed in 618us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.596051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788748260.597149:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007360:0@lo:501: 00000100:00100000:0.0:1788748260.597228:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007488:0@lo:503: 00000100:00100000:0.0:1788748260.597305:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.597346:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced123dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748260.597564:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007488 00000100:00100000:3.0:1788748260.597573:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007488 00000100:00100000:3.0:1788748260.597665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788748260.597677:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007488:12345-0@lo:503: 00000100:00100000:3.0:1788748260.598129:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007488:12345-0@lo:503: Request processed in 453us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.598139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788748260.598286:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007488:0@lo:503: 00000100:00100000:1.0:1788748260.603936:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8043:1875638377007616:0@lo:502: 00000100:00100000:1.0:1788748260.604058:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.604112:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.604130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007616 00000100:00100000:0.0:1788748260.604149:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007616 00000100:00100000:0.0:1788748260.604219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788748260.604230:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8043:x1875638377007616:12345-0@lo:502: 00000100:00100000:0.0:1788748260.604889:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8043:x1875638377007616:12345-0@lo:502: Request processed in 660us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.604899:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788748260.604947:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8043:1875638377007616:0@lo:502: 00000100:00100000:1.0:1788748260.605068:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8043:1875638377007744:0@lo:502: 00000100:00100000:1.0:1788748260.605126:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.605403:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.606454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007744 00000100:00100000:0.0:1788748260.606468:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007744 00000100:00100000:0.0:1788748260.606547:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788748260.606558:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8043:x1875638377007744:12345-0@lo:502: 00000100:00100000:0.0:1788748260.607101:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8043:x1875638377007744:12345-0@lo:502: Request processed in 544us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.607110:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748260.607148:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8043:1875638377007744:0@lo:502: 00000040:00080000:2.0:1788748260.607194:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788748260.607591:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788748260.607618:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748260.607631:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.607655:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748260.607667:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788748260.607671:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788748260.607674:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748260.607717:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.607726:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.607736:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748260.607761:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007872:0@lo:101: 00000100:00100000:3.0:1788748260.607812:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.607850:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.607943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377007872 00000100:00100000:0.0:1788748260.607950:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377007872 00000100:00100000:0.0:1788748260.607995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788748260.608004:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377007872:12345-0@lo:101: 00010000:00010000:0.0:1788748260.608042:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748260.610747:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bea8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.610800:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.610817:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.610828:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5400, rc 0) 00000100:00100000:0.0:1788748260.610956:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377007872:12345-0@lo:101: Request processed in 2950us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.610968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788748260.612825:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377007872:0@lo:101: 00010000:00010000:3.0:1788748260.612865:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.612881:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748260.613010:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008000:0@lo:501: 00000100:00100000:3.0:1788748260.613189:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.613250:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748260.613773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008000 00000100:00100000:2.0:1788748260.613783:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008000 00000100:00100000:2.0:1788748260.613836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788748260.613847:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377008000:12345-0@lo:501: 00000100:00100000:2.0:1788748260.614289:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377008000:12345-0@lo:501: Request processed in 442us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748260.614298:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788748260.615239:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008000:0@lo:501: 00000100:00100000:3.0:1788748260.615316:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008128:0@lo:503: 00000100:00100000:3.0:1788748260.615396:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.615742:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.616361:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008128 00000100:00100000:0.0:1788748260.616375:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008128 00000100:00100000:0.0:1788748260.616460:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788748260.616473:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377008128:12345-0@lo:503: 00000100:00100000:0.0:1788748260.616964:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377008128:12345-0@lo:503: Request processed in 493us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.616979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788748260.617711:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008128:0@lo:503: 00000100:00100000:1.0:1788748260.618931:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8045:1875638377008256:0@lo:502: 00000100:00100000:1.0:1788748260.619217:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.619268:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.619469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008256 00000100:00100000:0.0:1788748260.619478:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008256 00000100:00100000:0.0:1788748260.619539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788748260.619553:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8045:x1875638377008256:12345-0@lo:502: 00000100:00100000:0.0:1788748260.619922:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8045:x1875638377008256:12345-0@lo:502: Request processed in 371us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.619930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788748260.619956:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8045:1875638377008256:0@lo:502: 00000020:01000000:1.0:1788748260.619990:0:8045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748260.620002:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748260.620005:0:8045:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748260.620011:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748260.620042:0:8045:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788748260.620069:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8045:1875638377008384:0@lo:502: 00000100:00100000:1.0:1788748260.620109:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.620134:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748260.620195:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008384 00000100:00100000:2.0:1788748260.620201:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008384 00000100:00100000:2.0:1788748260.620238:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788748260.620247:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8045:x1875638377008384:12345-0@lo:502: 00000100:00100000:2.0:1788748260.620396:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8045:x1875638377008384:12345-0@lo:502: Request processed in 150us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748260.620402:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788748260.620578:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8045:1875638377008384:0@lo:502: 00000020:01000000:0.0:1788748260.620599:0:8045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748260.620604:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748260.620606:0:8045:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788748260.620612:0:8045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788748260.620894:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788748260.620931:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788748260.620944:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.620958:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748260.620970:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788748260.620974:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec8720800 from 30 10000000:01000000:2.0:1788748260.620978:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788748260.621011:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.621143:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.621156:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748260.621173:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008512:0@lo:101: 00000100:00100000:2.0:1788748260.621214:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748260.621256:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.621321:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008512 00000100:00100000:0.0:1788748260.621330:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008512 00000100:00100000:0.0:1788748260.621371:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748260.621379:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377008512:12345-0@lo:101: 00010000:00010000:0.0:1788748260.621392:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748260.621407:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7beb6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.621436:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.621449:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.621458:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5200, rc 0) 00000100:00100000:0.0:1788748260.621652:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377008512:12345-0@lo:101: Request processed in 273us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.621660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788748260.621723:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008512:0@lo:101: 00010000:00010000:2.0:1788748260.621739:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.621749:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748260.621808:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008640:0@lo:501: 00000100:00100000:2.0:1788748260.621838:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748260.621912:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.621946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008640 00000100:00100000:1.0:1788748260.621951:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008640 00000100:00100000:1.0:1788748260.622083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748260.622093:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377008640:12345-0@lo:501: 00000100:00100000:1.0:1788748260.622459:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377008640:12345-0@lo:501: Request processed in 367us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.622466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748260.622626:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008640:0@lo:501: 00000100:00100000:0.0:1788748260.622669:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008768:0@lo:503: 00000100:00100000:0.0:1788748260.622715:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.622752:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748260.622791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008768 00000100:00100000:2.0:1788748260.622797:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008768 00000100:00100000:2.0:1788748260.622830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788748260.622837:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377008768:12345-0@lo:503: 00000100:00100000:2.0:1788748260.623007:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377008768:12345-0@lo:503: Request processed in 170us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748260.623037:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748260.623114:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377008768:0@lo:503: 00000100:00100000:0.0:1788748260.624338:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8046:1875638377008896:0@lo:502: 00000100:00100000:0.0:1788748260.624415:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.624456:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748260.624566:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377008896 00000100:00100000:2.0:1788748260.624574:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377008896 00000100:00100000:2.0:1788748260.624626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788748260.624636:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8046:x1875638377008896:12345-0@lo:502: 00000100:00100000:2.0:1788748260.624930:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8046:x1875638377008896:12345-0@lo:502: Request processed in 295us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748260.624938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788748260.625063:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8046:1875638377008896:0@lo:502: 00000100:00100000:1.0:1788748260.625116:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8046:1875638377009024:0@lo:502: 00000100:00100000:1.0:1788748260.625153:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.625176:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748260.625237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009024 00000100:00100000:2.0:1788748260.625241:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009024 00000100:00100000:2.0:1788748260.625272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788748260.625287:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8046:x1875638377009024:12345-0@lo:502: 00000100:00100000:2.0:1788748260.625432:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8046:x1875638377009024:12345-0@lo:502: Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748260.625439:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788748260.625567:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8046:1875638377009024:0@lo:502: 00000040:00080000:1.0:1788748260.625588:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788748260.625834:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788748260.625858:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748260.625869:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.625881:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748260.625891:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748260.625894:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cec8720800 from 5 10000000:01000000:2.0:1788748260.625897:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748260.625937:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.625946:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748260.625955:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748260.625968:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009152:0@lo:101: 00000100:00100000:2.0:1788748260.625999:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748260.626065:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed7313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.626160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009152 00000100:00100000:1.0:1788748260.626165:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009152 00000100:00100000:1.0:1788748260.626197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788748260.626204:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377009152:12345-0@lo:101: 00010000:00010000:1.0:1788748260.626214:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748260.626230:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02056c00/0x5b377f42a7a7becb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bec4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.626254:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02056c00/0x5b377f42a7a7becb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bec4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.626265:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02056c00/0x5b377f42a7a7becb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bec4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.626275:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02056c00, rc 0) 00000100:00100000:1.0:1788748260.626316:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377009152:12345-0@lo:101: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.626322:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788748260.626388:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009152:0@lo:101: 00010000:00010000:0.0:1788748260.626403:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.626413:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748260.626483:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009280:0@lo:256: 00000100:00100000:0.0:1788748260.626522:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.626550:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.626649:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009280 00000100:00100000:1.0:1788748260.626654:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009280 00000100:00100000:1.0:1788748260.626685:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788748260.626692:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377009280:12345-0@lo:256: 20000000:01000000:1.0:1788748260.626706:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748260.626725:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748260.626728:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788748260.626801:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377009280:12345-0@lo:256: Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.626814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748260.627142:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009280:0@lo:256: 10000000:01000000:0.0:1788748260.627206:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748260.627215:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.627236:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748260.627246:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788748260.627249:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788748260.627253:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788748260.627276:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.627283:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.627292:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748260.627303:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009408:0@lo:101: 00000100:00100000:0.0:1788748260.627334:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.627391:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.628166:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009408 00000100:00100000:1.0:1788748260.628177:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009408 00000100:00100000:1.0:1788748260.628237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788748260.628246:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377009408:12345-0@lo:101: 00010000:00010000:1.0:1788748260.628265:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748260.628285:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bed2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.628313:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.628326:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.628336:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02057200, rc 0) 00000100:00100000:1.0:1788748260.628398:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377009408:12345-0@lo:101: Request processed in 153us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.628404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788748260.630336:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009408:0@lo:101: 00010000:00010000:0.0:1788748260.630375:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.630390:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748260.630657:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009536:0@lo:501: 00000100:00100000:0.0:1788748260.630733:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.630808:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.630832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009536 00000100:00100000:0.0:1788748260.630839:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009536 00000100:00100000:0.0:1788748260.630889:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748260.630899:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377009536:12345-0@lo:501: 00000100:00100000:0.0:1788748260.631323:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377009536:12345-0@lo:501: Request processed in 425us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.631332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748260.631385:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009536:0@lo:501: 00000100:00100000:0.0:1788748260.631422:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009664:0@lo:503: 00000100:00100000:0.0:1788748260.631466:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.632901:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.633290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009664 00000100:00100000:1.0:1788748260.633302:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009664 00000100:00100000:1.0:1788748260.633369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748260.633381:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377009664:12345-0@lo:503: 00000100:00100000:1.0:1788748260.634003:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377009664:12345-0@lo:503: Request processed in 622us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.634038:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788748260.634233:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377009664:0@lo:503: 00000100:00100000:0.0:1788748260.634930:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8047:1875638377009792:0@lo:502: 00000100:00100000:0.0:1788748260.634993:0:8047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.635111:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.635209:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009792 00000100:00100000:1.0:1788748260.635216:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009792 00000100:00100000:1.0:1788748260.635267:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748260.635275:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8047:x1875638377009792:12345-0@lo:502: 00000100:00100000:1.0:1788748260.635767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8047:x1875638377009792:12345-0@lo:502: Request processed in 490us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.635776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788748260.635864:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8047:1875638377009792:0@lo:502: 00000020:01000000:0.0:1788748260.635901:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788748260.635919:0:8047:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788748260.635928:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748260.635930:0:8047:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788748260.635936:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788748260.635940:0:8047:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1788748260.635966:0:8047:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788748260.635970:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788748260.635989:0:8047:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cefd4a0000) 00000020:00000080:0.0:1788748260.637007:0:8047:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788748260.637055:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788748260.637166:0:8047:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788748260.637174:0:8047:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788748260.637183:0:8047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7bee7 00010000:00080000:0.0:1788748260.637225:0:8047:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ceecebc000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788748260.637704:0:8047:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788748260.638883:0:8047:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788748260.638912:0:8047:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788748260.639894:0:8047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748260.640161:0:8047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748260.640213:0:8047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788748260.640268:0:8047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788748260.645984:0:8049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748260.645995:0:8049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788748260.648136:0:8047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748260.648151:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788748260.648193:0:8047:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788748260.648214:0:8047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7beee 00000100:00080000:3.0:1788748260.648225:0:8047:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748260.648236:0:8047:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ceecebc000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748260.648624:0:8047:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76ae300 x1875638377009920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748260.648653:0:8047:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788748260.648713:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748260.648718:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748260.648723:0:8047:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00100000:1.0:1788748260.648725:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377009920:0@lo:8: 00000020:01000000:3.0:1788748260.648728:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748260.648737:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748260.648741:0:8047:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748260.648745:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748260.648747:0:8047:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788748260.648785:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8047:1875638377010048:0@lo:502: 00000100:00100000:1.0:1788748260.648846:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.648879:0:8047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.648930:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.649040:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377010176:0@lo:400: 00000100:00100000:3.0:1788748260.649069:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377010560:0@lo:400: 00000100:00100000:1.0:1788748260.649085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.649128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.649168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010176 00000100:00100000:1.0:1788748260.649179:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010176 00000100:00100000:3.0:1788748260.649187:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377010304:0@lo:400: 00000100:00100000:3.0:1788748260.649230:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.649248:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010560 00000100:00100000:3.0:1788748260.649254:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748260.649254:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010560 00000100:00100000:3.0:1788748260.649275:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377010432:0@lo:400: 00000100:00100000:1.0:1788748260.649302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010304 00000100:00100000:3.0:1788748260.649308:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.649309:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010304 00000100:00100000:1.0:1788748260.649344:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748260.649354:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377010176:12345-0@lo:400: 00000100:00100000:3.0:1788748260.649369:0:5844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748260.649379:0:5844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788748260.649400:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748260.649416:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748260.649435:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377010560:12345-0@lo:400: 00000100:00100000:1.0:1788748260.649445:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377010176:12345-0@lo:400: Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.649456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748260.649482:0:5846:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748260.649492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748260.649503:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377010304:12345-0@lo:400: 00000100:00100000:3.0:1788748260.649515:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377010560:12345-0@lo:400: Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.649527:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788748260.649575:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748260.649588:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377009920 00000100:00100000:3.0:1788748260.649596:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377009920 00000100:00100000:3.0:1788748260.649620:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010432 00000100:00100000:3.0:1788748260.649624:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010432 00000100:00100000:1.0:1788748260.649632:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377010304:12345-0@lo:400: Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.649643:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748260.649658:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748260.649669:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377010432:12345-0@lo:400: 00010000:00080000:1.0:1788748260.649720:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76af480 x1875638377010176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748260.649737:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377010176:0@lo:400: 00000100:00100000:0.0:1788748260.650071:0:6695:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788748260.650081:0:6695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788748260.650096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010048 00000100:00100000:0.0:1788748260.650101:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010048 00000100:00100000:0.0:1788748260.650139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788748260.650147:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8047:x1875638377010048:12345-0@lo:502: 00000100:00100000:3.0:1788748260.652499:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377010432:12345-0@lo:400: Request processed in 2823us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.652516:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748260.653396:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748260.653406:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875638377009920:12345-0@lo:8: 00010000:00080000:3.0:1788748260.653444:0:6696:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788748260.653475:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7bef5 00002000:00100000:3.0:1788748260.653492:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cefd857800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788748260.653511:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788748260.653514:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788748260.653706:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788748260.653872:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788748260.653898:0:6696:0:(import.c:65:import_set_state_nolock()) ffff99cefd852000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748260.653982:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638377009920:12345-0@lo:8: Request processed in 576us (5140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.653990:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788748260.654062:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788748260.654099:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76af800 x1875638377010560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748260.654113:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377010560:0@lo:400: 00010000:00080000:3.0:1788748260.654151:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76aed80 x1875638377010432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748260.654161:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377010432:0@lo:400: 00010000:00080000:3.0:1788748260.654172:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76afb80 x1875638377010304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748260.654179:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377010304:0@lo:400: 00010000:00080000:1.0:1788748260.655148:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ae300 x1875638377009920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748260.655165:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748260.655177:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788748260.655188:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748260.655196:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788748260.655201:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748260.655221:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748260.655228:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377009920:0@lo:8: 00000004:00080000:1.0:1788748260.655270:0:8049:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748260.655438:0:8049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 177698421943ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788748260.657947:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8047:x1875638377010048:12345-0@lo:502: Request processed in 7786us (9056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748260.657967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748260.658177:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8047:1875638377010048:0@lo:502: 00000020:01000000:1.0:1788748260.658237:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748260.658250:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748260.658253:0:8047:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788748260.658261:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788748260.658446:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788748260.658470:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788748260.658483:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.658496:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748260.658523:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788748260.658526:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cee507b380 from 1 10000000:01000000:1.0:1788748260.658529:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788748260.658571:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.658579:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748260.658588:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748260.658610:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377010688:0@lo:101: 00000100:00100000:1.0:1788748260.658657:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.658709:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748260.659730:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010688 00000100:00100000:3.0:1788748260.659745:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010688 00000100:00100000:3.0:1788748260.659805:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748260.659815:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377010688:12345-0@lo:101: 00010000:00010000:3.0:1788748260.659832:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748260.659853:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7befc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.659898:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.659942:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.659951:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43600, rc 0) 00000100:00100000:3.0:1788748260.660694:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377010688:12345-0@lo:101: Request processed in 877us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748260.660703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748260.668159:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377010688:0@lo:101: 00010000:00010000:3.0:1788748260.668191:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748260.668205:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748260.687541:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377010816:0@lo:501: 00000100:00100000:0.0:1788748260.687623:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.687672:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.687694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010816 00000100:00100000:0.0:1788748260.687702:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010816 00000100:00100000:0.0:1788748260.687879:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748260.687890:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377010816:12345-0@lo:501: 00000100:00100000:0.0:1788748260.688214:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377010816:12345-0@lo:501: Request processed in 325us (591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748260.688232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748260.688430:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377010816:0@lo:501: 10000000:01000000:0.0:1788748260.688469:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788748260.688545:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748260.688557:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748260.741327:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1788748260.741658:0:8050:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788748260.741686:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011072:0@lo:7: 00000100:00100000:1.0:1788748260.741748:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.743033:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.743067:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011072 00000100:00100000:1.0:1788748260.743075:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011072 00000100:00100000:1.0:1788748260.743138:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748260.743147:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8050:x1875638377011072:12345-0@lo:7: 00000004:00080000:0.0:1788748260.744237:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788748260.746315:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748260.748058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377010944:0@lo:13: 00000100:00100000:3.0:1788748260.748165:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748260.749915:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377010944 00000100:00100000:1.0:1788748260.749927:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377010944 00000100:00100000:1.0:1788748260.749989:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748260.750000:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377010944:12345-0@lo:13: 00002000:00000024:1.0:1788748260.750070:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788748260.750153:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377010944:12345-0@lo:13: Request processed in 155us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.750161:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788748260.752937:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e0380 x1875638377010944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748260.752964:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377010944:0@lo:13: 00002000:00080000:1.0:1788748260.764038:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788748260.764050:0:6696:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788748260.764152:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8050:x1875638377011072:12345-0@lo:7: Request processed in 21003us (22400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.764163:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788748260.764296:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e3800 x1875638377011072/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748260.764312:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011072:0@lo:7: 00000004:00080000:0.0:1788748260.764327:0:8050:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788748260.764369:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011200:0@lo:5: 00000100:00100000:0.0:1788748260.764407:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.764455:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.768895:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011200 00000100:00100000:1.0:1788748260.768922:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011200 00000100:00100000:1.0:1788748260.768979:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748260.768995:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8050:x1875638377011200:12345-0@lo:5: 00002000:00080000:1.0:1788748260.769191:0:6695:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788748260.769196:0:6695:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788748260.769537:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8050:x1875638377011200:12345-0@lo:5: Request processed in 548us (5127us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1788748260.771351:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76a8e00 x1875638377011200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748260.771372:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011200:0@lo:5: 00000004:00080000:0.0:1788748260.771387:0:8050:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788748260.771427:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011328:0@lo:700: 00000100:00100000:0.0:1788748260.771477:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.771521:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748260.771539:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011328 00000100:00100000:0.0:1788748260.771544:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011328 00000100:00100000:0.0:1788748260.771590:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748260.771599:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:8050:x1875638377011328:12345-0@lo:700: 00000100:00100000:0.0:1788748260.771632:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875638377011456:0@lo:700: 00000100:00100000:0.0:1788748260.771658:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748260.771677:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748260.772852:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748260.772920:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011456 00000100:00100000:1.0:1788748260.772926:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011456 00000100:00100000:1.0:1788748260.772972:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748260.772981:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875638377011456:12345-0@lo:700: 40000000:02000000:1.0:1788748260.851257:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788748260.858693:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875638377011456:12345-0@lo:700: Request processed in 85705us (87025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.858708:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748260.859067:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ab480 x1875638377011456/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788748276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748260.859082:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875638377011456:0@lo:700: 40000000:02000000:0.0:1788748260.859094:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788748260.937121:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8050:x1875638377011328:12345-0@lo:700: Request processed in 165513us (165634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748260.937158:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788748260.937246:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788748260.937258:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788748260.937337:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76a9180 x1875638377011328/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748260.937355:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011328:0@lo:700: 00000004:02000040:3.0:1788748260.977038:0:8050:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788748260.984629:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011584:0@lo:5: 00000100:00100000:3.0:1788748260.984703:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748260.984746:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011584 00000100:00100000:3.0:1788748260.984753:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011584 00000100:00100000:3.0:1788748260.984800:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748260.984808:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8050:x1875638377011584:12345-0@lo:5: 00000100:00100000:1.0:1788748260.987142:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00002000:00080000:3.0:1788748260.992482:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788748260.992502:0:6697:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788748261.003663:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8050:x1875638377011584:12345-0@lo:5: Request processed in 18849us (18966us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788748261.003675:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788748261.003792:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad5180 x1875638377011584/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748261.003807:0:8050:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788748261.003824:0:8050:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99ced2ad5180 x1875638377011584/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748276 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748261.003839:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875638377011584:0@lo:5: 00000004:00080000:1.0:1788748261.003854:0:8050:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788748261.486141:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748261.613332:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748261.613361:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377011712:0@lo:13: 00000100:00100000:0.0:1788748261.613428:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748261.613581:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011712 00000100:00100000:1.0:1788748261.613589:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011712 00000100:00100000:1.0:1788748261.613641:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748261.613651:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377011712:12345-0@lo:13: 00002000:00000024:1.0:1788748261.613700:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748261.613757:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377011712:12345-0@lo:13: Request processed in 108us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748261.613765:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788748261.614003:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e0700 x1875638377011712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748261.614046:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377011712:0@lo:13: 00010000:00010000:0.0:1788748262.510065:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748263.533435:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748264.557817:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788748264.631962:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788748265.079475:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748265.079867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358114432 00000100:00100000:0.0:1788748265.079888:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358114432 00000100:00100000:1.0:1788748265.080335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:1.0:1788748265.080357:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875638358114432:12345-192.168.203.4@tcp:250: 00010000:00080000:1.0:1788748265.080388:0:5839:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 62c24351-d204-4cbb-bccb-959b10d053e2@192.168.203.4@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1788748265.080415:0:5839:0:(genops.c:1384:class_connect()) connect: client 62c24351-d204-4cbb-bccb-959b10d053e2, cookie 0x5b377f42a7a7bf0a 00000100:00080000:1.0:1788748265.080554:0:5839:0:(import.c:65:import_set_state_nolock()) ffff99cefbb3d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748265.080628:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+5:2346:x1875638358114432:12345-192.168.203.4@tcp:250: Request processed in 282us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.080636:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:2.0:1788748265.088577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748265.088611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358114560 00000100:00100000:2.0:1788748265.088620:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358114560 00000100:00100000:2.0:1788748265.088661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:2.0:1788748265.088670:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+5:5576:x1875638358114560:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788748265.088686:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748265.088701:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521506 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.088725:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.088735:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.088744:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d400, rc 0) 00000100:00100000:2.0:1788748265.088797:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+6:5576:x1875638358114560:12345-192.168.203.4@tcp:101: Request processed in 128us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.088803:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:0.0:1788748265.101743:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748265.101856:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358114688 00000100:00100000:2.0:1788748265.101866:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358114688 00000100:00100000:2.0:1788748265.101933:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1788748265.101943:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+6:5576:x1875638358114688:12345-192.168.203.4@tcp:501: 00000100:00100000:1.0:1788748265.103911:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+6:5576:x1875638358114688:12345-192.168.203.4@tcp:501: Request processed in 1960us (2169us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748265.103926:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1788748265.110664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748265.110830:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358114816 00000100:00100000:0.0:1788748265.110840:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358114816 00000100:00100000:0.0:1788748265.110918:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1788748265.110928:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+6:5576:x1875638358114816:12345-192.168.203.4@tcp:101: 00010000:00010000:0.0:1788748265.110946:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748265.110964:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee622652150d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.110992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.111003:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.111011:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4a00, rc 0) 00000100:00100000:0.0:1788748265.111082:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+7:5576:x1875638358114816:12345-192.168.203.4@tcp:101: Request processed in 155us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.111089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:3.0:1788748265.112746:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748265.112906:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358114944 00000100:00100000:0.0:1788748265.112917:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358114944 00000100:00100000:0.0:1788748265.112963:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1788748265.112972:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+7:5576:x1875638358114944:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1788748265.115814:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:5576:x1875638358114944:12345-192.168.203.4@tcp:501: Request processed in 2830us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.115828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:3.0:1788748265.119920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748265.119995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115072 00000100:00100000:2.0:1788748265.120008:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115072 00000100:00100000:2.0:1788748265.120079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788748265.120088:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+8:5576:x1875638358115072:12345-192.168.203.4@tcp:503: 00000100:00100000:2.0:1788748265.120619:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+8:5576:x1875638358115072:12345-192.168.203.4@tcp:503: Request processed in 529us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.120628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788748265.132373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748265.132518:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115200 00000100:00100000:1.0:1788748265.132529:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115200 00000100:00100000:1.0:1788748265.132585:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:1.0:1788748265.132595:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:5596:x1875638358115200:12345-192.168.203.4@tcp:502: 00000100:00100000:1.0:1788748265.134729:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:5596:x1875638358115200:12345-192.168.203.4@tcp:502: Request processed in 2125us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.134744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:1.0:1788748265.158648:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748265.158776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115328 00000100:00100000:3.0:1788748265.158787:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115328 00000100:00100000:3.0:1788748265.158841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:3.0:1788748265.158851:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+8:5596:x1875638358115328:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788748265.159140:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+8:5596:x1875638358115328:12345-192.168.203.4@tcp:502: Request processed in 290us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.159149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1788748265.170701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748265.170906:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115456 00000100:00100000:0.0:1788748265.170918:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115456 00000100:00100000:0.0:1788748265.170976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:0.0:1788748265.170987:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:5576:x1875638358115456:12345-192.168.203.4@tcp:101: 00010000:00010000:0.0:1788748265.171037:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748265.171056:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7bf1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521537 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.171088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7bf1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521537 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.171099:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7bf1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521537 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.171108:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5600, rc 0) 00000100:00100000:0.0:1788748265.171160:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:5576:x1875638358115456:12345-192.168.203.4@tcp:101: Request processed in 175us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.171168:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788748265.177712:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748265.177788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115584 00000100:00100000:2.0:1788748265.177797:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115584 00000100:00100000:2.0:1788748265.177847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1788748265.177856:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:5576:x1875638358115584:12345-192.168.203.4@tcp:256: 20000000:01000000:2.0:1788748265.177891:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788748265.177918:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788748265.177922:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788748265.177925:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788748265.177927:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788748265.182258:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:5576:x1875638358115584:12345-192.168.203.4@tcp:256: Request processed in 4389us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.182836:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1788748265.193106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748265.193187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115712 00000100:00100000:3.0:1788748265.193197:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115712 00000100:00100000:3.0:1788748265.193254:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1788748265.193264:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+9:5576:x1875638358115712:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788748265.193288:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748265.193306:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee622652153e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.193339:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.193359:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.193368:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748265.193430:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:5576:x1875638358115712:12345-192.168.203.4@tcp:101: Request processed in 167us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.193436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1788748265.200282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748265.200452:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115840 00000100:00100000:3.0:1788748265.200464:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115840 00000100:00100000:3.0:1788748265.200517:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1788748265.200527:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5576:x1875638358115840:12345-192.168.203.4@tcp:501: 00000100:00100000:3.0:1788748265.200794:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5576:x1875638358115840:12345-192.168.203.4@tcp:501: Request processed in 267us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.200802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1788748265.202588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748265.202667:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358115968 00000100:00100000:0.0:1788748265.202675:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358115968 00000100:00100000:0.0:1788748265.202723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:0.0:1788748265.202732:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:5576:x1875638358115968:12345-192.168.203.4@tcp:503: 00000100:00100000:0.0:1788748265.203169:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:5576:x1875638358115968:12345-192.168.203.4@tcp:503: Request processed in 435us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.203178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1788748265.211047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748265.211084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116096 00000100:00100000:1.0:1788748265.211094:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116096 00000100:00100000:1.0:1788748265.211144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:1.0:1788748265.211154:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:5601:x1875638358116096:12345-192.168.203.4@tcp:502: 00000100:00100000:1.0:1788748265.212713:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:5601:x1875638358116096:12345-192.168.203.4@tcp:502: Request processed in 1550us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.212725:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:0.0:1788748265.228482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748265.228802:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116224 00000100:00100000:3.0:1788748265.228812:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116224 00000100:00100000:3.0:1788748265.228921:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788748265.228933:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5601:x1875638358116224:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788748265.229357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5601:x1875638358116224:12345-192.168.203.4@tcp:502: Request processed in 424us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.229366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788748265.235555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748265.235609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116352 00000100:00100000:3.0:1788748265.235620:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116352 00000100:00100000:3.0:1788748265.235667:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748265.235680:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875638358116352:12345-192.168.203.4@tcp:38: 00010000:00080000:3.0:1788748265.235716:0:5845:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1788748265.235763:0:5845:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7bf2d 00000004:00100000:3.0:1788748265.235799:0:5845:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788748265.235806:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788748265.289498:0:5845:0:(import.c:65:import_set_state_nolock()) ffff99cefd78f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748265.289730:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358116352:12345-192.168.203.4@tcp:38: Request processed in 54050us (54182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.289741:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00010000:00010000:0.0:1788748265.581708:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748265.709297:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748265.709439:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377011968:0@lo:400: 00000100:00100000:0.0:1788748265.709650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.709747:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011968 00000100:00100000:3.0:1788748265.709748:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377011840:0@lo:400: 00000100:00100000:1.0:1788748265.709756:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011968 00000100:00100000:3.0:1788748265.709790:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.709810:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748265.709821:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377011968:12345-0@lo:400: 00000100:00100000:3.0:1788748265.710009:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377012096:0@lo:400: 00000100:00100000:3.0:1788748265.710064:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.710097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012096 00000100:00100000:3.0:1788748265.710101:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012096 00000100:00100000:3.0:1788748265.710139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748265.710160:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377012096:12345-0@lo:400: 00000100:00100000:3.0:1788748265.710206:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377012096:12345-0@lo:400: Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.710213:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788748265.710251:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194ca80 x1875638377012096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748265.710264:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377012096:0@lo:400: 00000100:00100000:3.0:1788748265.710295:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377011840 00000100:00100000:3.0:1788748265.710298:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377011840 00000100:00100000:3.0:1788748265.710335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748265.710341:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377011840:12345-0@lo:400: 00000100:00100000:3.0:1788748265.710371:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377011840:12345-0@lo:400: Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.710377:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748265.710410:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377011840:0@lo:400: 00000100:00080000:3.0:1788748265.710434:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748265.711057:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377012352:0@lo:400: 00000100:00100000:2.0:1788748265.711089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.711109:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748265.711113:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377012224:0@lo:400: 00000100:00100000:2.0:1788748265.711134:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.711159:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012352 00000100:00100000:2.0:1788748265.711163:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012352 00000100:00100000:2.0:1788748265.711194:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748265.711200:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377012352:12345-0@lo:400: 00000100:00100000:2.0:1788748265.711231:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377012352:12345-0@lo:400: Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.711236:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788748265.711259:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194d500 x1875638377012352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748265.711278:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377012352:0@lo:400: 00000100:00080000:2.0:1788748265.711292:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748265.711323:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748265.711331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377012480:0@lo:400: 00000100:00100000:2.0:1788748265.711357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.711379:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377011968:12345-0@lo:400: Request processed in 1558us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.711399:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012224 00000100:00100000:2.0:1788748265.711403:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012224 00000100:00100000:2.0:1788748265.711426:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012480 00000100:00100000:2.0:1788748265.711428:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012480 00000100:00100000:2.0:1788748265.711454:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748265.711460:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377012224:12345-0@lo:400: 00000100:00100000:2.0:1788748265.711491:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377012224:12345-0@lo:400: Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.711496:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748265.711506:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748265.711511:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377012480:12345-0@lo:400: 00000100:00100000:2.0:1788748265.711534:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377012480:12345-0@lo:400: Request processed in 23us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.711539:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748265.711617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788748265.711667:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194d180 x1875638377012224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748265.711678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377012224:0@lo:400: 00000100:00080000:2.0:1788748265.711693:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748265.711696:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748265.711709:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194ce00 x1875638377012480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748265.711727:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788748265.711736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377012480:0@lo:400: 00010000:00080000:0.0:1788748265.712108:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194f800 x1875638377011968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748265.712132:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377011968:0@lo:400: 00000100:00100000:2.0:1788748266.221801:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377012608:0@lo:13: 00000100:00100000:2.0:1788748266.221882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748266.221978:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012608 00000100:00100000:1.0:1788748266.221986:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012608 00000100:00100000:1.0:1788748266.222109:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748266.222117:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377012608:12345-0@lo:13: 00002000:00000024:1.0:1788748266.222147:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748266.222198:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377012608:12345-0@lo:13: Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748266.222205:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788748266.222236:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e2680 x1875638377012608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748266.222254:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377012608:0@lo:13: 00000100:00100000:1.0:1788748266.293912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748266.294045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.298254:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116480 00000100:00100000:2.0:1788748266.298271:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116480 00000100:00100000:2.0:1788748266.298404:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116608 00000100:00100000:2.0:1788748266.298409:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116608 00000100:00100000:2.0:1788748266.298448:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748266.298460:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:0:x1875638358116480:12345-192.168.203.4@tcp:41: 00000004:00000024:2.0:1788748266.298503:0:8052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788748266.298582:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:0:x1875638358116480:12345-192.168.203.4@tcp:41: Request processed in 124us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748266.298590:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748266.298723:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748266.298732:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358116608:12345-192.168.203.4@tcp:41: 00000004:00000024:2.0:1788748266.298744:0:8052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788748266.298769:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358116608:12345-192.168.203.4@tcp:41: Request processed in 38us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748266.298775:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00080000:0.0:1788748266.300780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748266.302947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.303107:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116736 00000100:00100000:2.0:1788748266.303129:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116736 00000100:00100000:2.0:1788748266.303185:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748266.303195:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358116736:12345-192.168.203.4@tcp:40: 00000100:00100000:2.0:1788748266.303371:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358116736:12345-192.168.203.4@tcp:40: Request processed in 177us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748266.303379:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748266.312087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748266.312487:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116864 00000100:00100000:1.0:1788748266.312497:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116864 00000100:00100000:1.0:1788748266.312544:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748266.312552:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875638358116864:12345-192.168.203.4@tcp:8: 00010000:00080000:1.0:1788748266.312584:0:6695:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1788748266.312628:0:6695:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7bf34 00002000:00100000:1.0:1788748266.312640:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b6e58be-3dc9-4518-a85f-e723d86d70a3/ffff99cefbb3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748266.312665:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748266.313100:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748266.313133:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99cefbb3a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748266.313195:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358116864:12345-192.168.203.4@tcp:8: Request processed in 642us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748266.313204:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748266.314132:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.314223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.314260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.314283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117120 00000100:00100000:2.0:1788748266.314289:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117120 00000100:00100000:2.0:1788748266.314342:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1788748266.314350:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358117120:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788748266.314390:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358117120:12345-192.168.203.4@tcp:400: Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748266.314396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1788748266.314905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117248 00000100:00100000:3.0:1788748266.314910:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117248 00000100:00100000:3.0:1788748266.314954:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788748266.314961:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358117248:12345-192.168.203.4@tcp:33: 00000100:00100000:1.0:1788748266.317429:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358116992 00000100:00100000:1.0:1788748266.317454:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358116992 00000100:00100000:1.0:1788748266.317534:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748266.317543:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875638358116992:12345-192.168.203.4@tcp:8: 00010000:00080000:1.0:1788748266.317574:0:8053:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1788748266.317616:0:8053:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7bf3b 00002000:00100000:1.0:1788748266.317629:0:8053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7b6e58be-3dc9-4518-a85f-e723d86d70a3/ffff99cefbb3a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748266.317640:0:8053:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748266.318421:0:8053:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748266.318516:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cefbb39800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748266.318592:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358116992:12345-192.168.203.4@tcp:8: Request processed in 1047us (4461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748266.318727:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000004:00080000:3.0:1788748266.354186:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39171us 00000004:00200000:3.0:1788748266.376054:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748266.376177:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5576:x1875638358117248:12345-192.168.203.4@tcp:33: Request processed in 61210us (61948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748266.376189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00010000:00010000:2.0:1788748266.605354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748266.617128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748266.617498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117376 00000100:00100000:2.0:1788748266.617509:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117376 00000100:00100000:2.0:1788748266.617576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748266.617587:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5618:x1875638358117376:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788748266.617610:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748266.617659:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7bf42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521568 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617727:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617760:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617774:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748266.617809:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748266.617812:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748266.617826:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617850:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7bf42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521568 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617882:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521568 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748266.617891:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748266.617894:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748266.617898:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:2.0:1788748266.618108:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:5618:x1875638358117376:12345-192.168.203.4@tcp:101: Request processed in 522us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748266.618117:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748266.733564:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748266.733591:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377012736:0@lo:13: 00000100:00100000:2.0:1788748266.733660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748266.733797:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012736 00000100:00100000:0.0:1788748266.733805:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012736 00000100:00100000:0.0:1788748266.733859:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748266.733891:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377012736:12345-0@lo:13: 00002000:00000024:0.0:1788748266.733913:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748266.733968:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377012736:12345-0@lo:13: Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748266.733975:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788748266.734059:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e0380 x1875638377012736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748266.734097:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377012736:0@lo:13: 00010000:00010000:2.0:1788748267.631051:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748268.653363:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748268.816857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748268.816987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117504 00000100:00100000:3.0:1788748268.816997:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117504 00000100:00100000:3.0:1788748268.817092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788748268.817104:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:5670:x1875638358117504:12345-192.168.203.4@tcp:41: 00000004:00000024:3.0:1788748268.817145:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788748268.817210:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:5670:x1875638358117504:12345-192.168.203.4@tcp:41: Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748268.817217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:0.0:1788748268.819923:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748268.824170:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748268.824266:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117632 00000100:00100000:3.0:1788748268.824277:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117632 00000100:00100000:3.0:1788748268.824357:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788748268.824376:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5670:x1875638358117632:12345-192.168.203.4@tcp:13: 00002000:00000024:3.0:1788748268.824417:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748268.824478:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5670:x1875638358117632:12345-192.168.203.4@tcp:13: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748268.824606:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00080000:2.0:1788748268.825210:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748268.826321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748268.826462:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117760 00000100:00100000:1.0:1788748268.826470:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117760 00000100:00100000:1.0:1788748268.826536:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748268.826545:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5670:x1875638358117760:12345-192.168.203.4@tcp:13: 00002000:00000024:1.0:1788748268.826578:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788748268.826868:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748268.826943:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:5670:x1875638358117760:12345-192.168.203.4@tcp:13: Request processed in 397us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748268.826951:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000001:00100000:2.0:1788748268.872125:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00010000:00010000:1.0:1788748269.679127:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788748270.389524:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00010000:00010000:3.0:1788748270.702483:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748270.829588:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377012864:0@lo:400: 00000100:00100000:1.0:1788748270.829695:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.829757:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377013376:0@lo:400: 00000100:00100000:1.0:1788748270.829787:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.829859:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748270.829866:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377013248:0@lo:400: 00000100:00100000:1.0:1788748270.829952:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.829988:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377012992:0@lo:400: 00000100:00100000:1.0:1788748270.830035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.830054:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377013504:0@lo:400: 00000100:00100000:1.0:1788748270.830092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.830113:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748270.830119:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377013120:0@lo:400: 00000100:00100000:1.0:1788748270.830156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.830191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012864 00000100:00100000:1.0:1788748270.830201:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012864 00000100:00100000:1.0:1788748270.830259:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788748270.830268:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377012864:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830333:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377012864:12345-0@lo:400: Request processed in 65us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788748270.830378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013376 00000100:00100000:1.0:1788748270.830382:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013376 00000100:00100000:1.0:1788748270.830420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377012992 00000100:00100000:1.0:1788748270.830423:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377012992 00000100:00100000:1.0:1788748270.830439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013120 00000100:00100000:1.0:1788748270.830441:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013120 00000100:00100000:1.0:1788748270.830456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748270.830463:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377013376:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830497:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377013376:12345-0@lo:400: Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748270.830522:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748270.830528:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377012992:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830564:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377012992:12345-0@lo:400: Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830570:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748270.830581:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788748270.830587:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377013120:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830611:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377013120:12345-0@lo:400: Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788748270.830636:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013248 00000100:00100000:1.0:1788748270.830639:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013248 00000100:00100000:1.0:1788748270.830669:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013504 00000100:00100000:1.0:1788748270.830672:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013504 00000100:00100000:1.0:1788748270.830692:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748270.830699:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377013248:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830730:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377013248:12345-0@lo:400: Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830736:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748270.830747:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748270.830753:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377013504:12345-0@lo:400: 00000100:00100000:1.0:1788748270.830780:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377013504:12345-0@lo:400: Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.830786:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788748270.830826:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748270.830831:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748270.830844:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748270.830901:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377013120:0@lo:400: 00000100:00100000:1.0:1788748270.830912:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377012992:0@lo:400: 00010000:00080000:1.0:1788748270.830923:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76afb80 x1875638377013504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748270.830933:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377013504:0@lo:400: 00010000:00080000:1.0:1788748270.830968:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ace00 x1875638377013248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748270.830977:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377013248:0@lo:400: 00000100:00100000:1.0:1788748270.830986:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377012864:0@lo:400: 00000100:00100000:1.0:1788748270.830997:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377013376:0@lo:400: 00000001:00100000:2.0:1788748270.886516:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000100:00100000:0.0:1788748271.341465:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748271.341501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377013632:0@lo:13: 00000100:00100000:0.0:1788748271.341605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.341703:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013632 00000100:00100000:2.0:1788748271.341715:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013632 00000100:00100000:2.0:1788748271.341783:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748271.341794:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377013632:12345-0@lo:13: 00002000:00000024:2.0:1788748271.341850:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748271.341916:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377013632:12345-0@lo:13: Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748271.341923:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788748271.342066:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad5c00 x1875638377013632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748271.342088:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377013632:0@lo:13: 00000100:00100000:2.0:1788748271.652871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748271.652935:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748271.652979:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748271.653010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748271.653067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358117888 00000100:00100000:2.0:1788748271.653080:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358117888 00000100:00100000:2.0:1788748271.653144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788748271.653156:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358117888:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788748271.653246:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358117888:12345-192.168.203.4@tcp:400: Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748271.653261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:0.0:1788748271.653462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118016 00000100:00100000:0.0:1788748271.653467:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118016 00000100:00100000:0.0:1788748271.653527:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788748271.653536:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358118016:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788748271.653580:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358118016:12345-192.168.203.4@tcp:400: Request processed in 46us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.653596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1788748271.653666:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118272 00000100:00100000:0.0:1788748271.653671:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118272 00000100:00100000:0.0:1788748271.653699:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118144 00000100:00100000:0.0:1788748271.653702:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118144 00000100:00100000:0.0:1788748271.653726:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748271.653734:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118272:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788748271.653768:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118272:12345-192.168.203.4@tcp:400: Request processed in 34us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.653774:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748271.653786:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748271.653792:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118144:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788748271.653815:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118144:12345-192.168.203.4@tcp:400: Request processed in 24us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.653821:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:2.0:1788748271.653926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748271.653932:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748271.653935:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788748271.677601:0:8303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788748271.726195:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748271.854505:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377013760:0@lo:13: 00000100:00100000:2.0:1788748271.854599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.854804:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377013760 00000100:00100000:2.0:1788748271.854815:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377013760 00000100:00100000:2.0:1788748271.854886:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748271.854897:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377013760:12345-0@lo:13: 00002000:00000024:2.0:1788748271.854946:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748271.855006:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377013760:12345-0@lo:13: Request processed in 111us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748271.855052:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788748271.855101:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7038380 x1875638377013760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748271.855124:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377013760:0@lo:13: 00010000:00010000:2.0:1788748272.751120:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748273.781298:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748274.797382:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748274.803748:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcfd59f00 20000000:00000080:1.0:1788748274.803770:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cefbb09800 uarg=0000000000000000 20000000:01000000:1.0:1788748274.803829:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788748274.803833:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788748274.803836:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788748274.803842:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788748274.803848:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788748274.803865:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788748274.803868:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788748274.804219:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788748274.804222:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788748274.805547:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788748274.806250:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788748274.806332:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788748274.806373:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788748274.806387:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788748274.806462:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788748274.807369:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788748274.807888:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788748274.807960:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788748274.808051:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788748274.808067:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788748274.808071:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788748274.809605:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788748274.810267:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788748274.810324:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788748274.810379:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788748274.810489:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788748274.810493:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788748274.811595:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788748274.812493:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788748274.812575:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788748274.812613:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1788748274.812631:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788748274.812654:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812686:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812695:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812702:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812709:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812717:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812724:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812732:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812743:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812750:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812757:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812830:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.812849:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.812868:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377013888:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748274.813092:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813102:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 9 pid: 5836 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813110:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014016:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748274.813142:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813149:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 18 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813158:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014144:0@lo:104: 00000100:00100000:0.0:1788748274.813200:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748274.813253:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813261:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813279:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014272:0@lo:104: 00000100:00100000:0.0:1788748274.813304:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748274.813333:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813341:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813349:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014400:0@lo:104: 00010000:00010000:0.0:1788748274.813371:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813379:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813387:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014528:0@lo:104: 00010000:00010000:0.0:1788748274.813421:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813428:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813437:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014656:0@lo:104: 00010000:00010000:0.0:1788748274.813459:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813467:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813486:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014784:0@lo:104: 00010000:00010000:0.0:1788748274.813510:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.813519:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 18 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.813526:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014912:0@lo:104: 00000100:00100000:0.0:1788748274.813542:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788748274.813710:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788748274.813731:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748274.813758:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748274.813767:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748274.813775:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748274.813783:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748274.813792:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014144 00000100:00100000:3.0:1788748274.813800:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014144 00000100:00100000:3.0:1788748274.813871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014272 00000100:00100000:3.0:1788748274.813875:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014272 00000100:00100000:3.0:1788748274.813898:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014400 00000100:00100000:3.0:1788748274.813901:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014400 00000100:00100000:3.0:1788748274.813911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014528 00000100:00100000:3.0:1788748274.813913:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014528 00000100:00100000:3.0:1788748274.813922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014656 00000100:00100000:3.0:1788748274.813926:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014656 00000100:00100000:3.0:1788748274.813934:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014784 00000100:00100000:3.0:1788748274.813936:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014784 00000100:00100000:3.0:1788748274.813945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377014912 00000100:00100000:3.0:1788748274.813947:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377014912 00000100:00100000:3.0:1788748274.813961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748274.813971:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:8452:x1875638377014144:12345-0@lo:104: 00010000:00010000:3.0:1788748274.813987:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.814080:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748274.814087:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+9:8452:x1875638377014144:12345-0@lo:104: Request processed in 118us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748274.814095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748274.814114:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748274.814120:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc473fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+8:8452:x1875638377014272:12345-0@lo:104: 00010000:00010000:3.0:1788748274.814128:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.814163:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748274.814168:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc473fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+8:8452:x1875638377014272:12345-0@lo:104: Request processed in 50us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748274.814174:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748274.814220:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748274.814226:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+7:8452:x1875638377014400:12345-0@lo:104: 00010000:00010000:3.0:1788748274.814241:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.814277:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788748274.814282:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+7:8452:x1875638377014400:12345-0@lo:104: Request processed in 57us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748274.814288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748274.814302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748274.814308:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:8452:x1875638377014528:12345-0@lo:104: 00010000:00010000:3.0:1788748274.814315:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.814340:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788748274.814344:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+6:8452:x1875638377014528:12345-0@lo:104: Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748274.814349:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748274.814359:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748274.814364:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:8452:x1875638377014656:12345-0@lo:104: 00010000:00010000:3.0:1788748274.814371:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.814575:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748274.814586:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:8452:x1875638377014784:12345-0@lo:104: 00010000:00010000:1.0:1788748274.814596:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.814654:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788748274.814660:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:8452:x1875638377014656:12345-0@lo:104: Request processed in 295us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748274.814666:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748274.814680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788748274.814688:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:8452:x1875638377014912:12345-0@lo:104: 00010000:00010000:3.0:1788748274.814702:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815146:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788748274.815155:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815165:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815178:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815188:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815196:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748274.815203:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748274.815243:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815251:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815271:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7befc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bf03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815294:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788748274.815298:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815304:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815307:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815314:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815332:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748274.815352:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748274.815367:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815372:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815403:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815410:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e5a00/0x5b377f42a7a7bed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815420:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748274.815423:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815538:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815541:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.815547:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1788748274.815548:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815554:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.815556:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:8452:x1875638377014784:12345-0@lo:104: Request processed in 972us (1777us total) trans 0 rc 0/0 10000000:01000000:2.0:1788748274.815560:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788748274.815565:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788748274.815579:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815586:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815592:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815598:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7beb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bebd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815609:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748274.815613:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815619:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815622:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815629:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815634:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748274.815639:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748274.815651:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815657:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815662:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815678:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b43c00/0x5b377f42a7a7bea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7beaf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815688:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748274.815691:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815697:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815700:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815704:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815709:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748274.815712:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748274.815722:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815725:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815728:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815734:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b42e00/0x5b377f42a7a7be9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bea1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815743:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748274.815752:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815758:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748274.815761:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815767:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748274.815774:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748274.815779:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748274.815792:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815798:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748274.815815:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815822:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7be70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be77 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.815833:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748274.815836:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748274.815837:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748274.815846:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748274.815871:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015040:0@lo:103: 00000100:00100000:2.0:1788748274.815922:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748274.816033:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014144:0@lo:104: 00000100:00100000:0.0:1788748274.816053:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014272:0@lo:104: 00000100:00100000:0.0:1788748274.816067:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014400:0@lo:104: 00010000:00010000:3.0:1788748274.816072:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748274.816082:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:8452:x1875638377014912:12345-0@lo:104: Request processed in 1393us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748274.816082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015040 00000100:00100000:0.0:1788748274.816084:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014528:0@lo:104: 00000100:00100000:1.0:1788748274.816091:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015040 00000100:00100000:0.0:1788748274.816098:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014656:0@lo:104: 00000100:00100000:3.0:1788748274.816099:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748274.816107:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015552:0@lo:103: 00000100:00100000:0.0:1788748274.816111:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014784:0@lo:104: 00010000:00010000:3.0:1788748274.816128:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748274.816134:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816136:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.816136:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014912:0@lo:104: 00000100:00100000:2.0:1788748274.816147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748274.816154:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748274.816159:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.816168:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748274.816175:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.816176:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015552 00000100:00100000:0.0:1788748274.816182:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015552 00000100:00100000:1.0:1788748274.816183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:01000000:3.0:1788748274.816189:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788748274.816192:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748274.816195:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3309:x1875638377015040:12345-0@lo:103: 00000100:00100000:2.0:1788748274.816201:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015424:0@lo:103: 00010000:00010000:0.0:1788748274.816204:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 20 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816209:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748274.816213:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816216:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 20 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.816231:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788748274.816231:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748274.816234:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788748274.816238:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 20 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.816239:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.816245:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3309:x1875638377015552:12345-0@lo:103: 00010000:00010000:3.0:1788748274.816257:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7be46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be4d expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816257:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748274.816263:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 20 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816264:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7bf03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7befc expref: 20 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748274.816268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015168:0@lo:103: 00010000:00010000:0.0:1788748274.816289:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 20 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748274.816298:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748274.816300:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748274.816300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748274.816300:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748274.816304:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748274.816308:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7be9a expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748274.816316:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015680:0@lo:103: 00010000:00010000:0.0:1788748274.816322:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748274.816352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748274.816361:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3309:x1875638377015040:12345-0@lo:103: Request processed in 167us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.816361:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3309:x1875638377015552:12345-0@lo:103: Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.816370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748274.816371:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748274.816380:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015296:0@lo:103: 00000100:00100000:0.0:1788748274.816387:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015424 00000100:00100000:0.0:1788748274.816392:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015424 00010000:00010000:0.0:1788748274.816406:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748274.816415:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015040:0@lo:103: 00000100:00100000:3.0:1788748274.816427:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015552:0@lo:103: 00000100:00100000:1.0:1788748274.816427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748274.816447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015168 00000100:00100000:1.0:1788748274.816452:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015168 00010000:00010000:1.0:1788748274.816465:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 18 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.816478:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015680 00000100:00100000:1.0:1788748274.816480:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015680 00000100:00100000:0.0:1788748274.816486:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788748274.816490:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.816492:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377015168:12345-0@lo:103: 00010000:00010000:0.0:1788748274.816499:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748274.816503:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816511:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816522:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bed2 expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748274.816530:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748274.816533:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748274.816543:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015808:0@lo:103: 00000100:00100000:0.0:1788748274.816568:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3306:x1875638377015168:12345-0@lo:103: Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748274.816570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748274.816584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748274.816590:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015168:0@lo:103: 00010000:00010000:2.0:1788748274.816607:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748274.816615:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015296 00000100:00100000:0.0:1788748274.816620:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015296 00010000:00010000:0.0:1788748274.816634:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.816642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015808 00000100:00100000:1.0:1788748274.816645:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015808 00000100:00100000:0.0:1788748274.816645:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748274.816651:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377015424:12345-0@lo:103: 00010000:00010000:1.0:1788748274.816658:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 19 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816658:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748274.816662:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816669:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.816670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748274.816675:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377015680:12345-0@lo:103: 00010000:00010000:0.0:1788748274.816680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7beaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bea8 expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816681:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748274.816685:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 19 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816700:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748274.816703:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816713:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7be77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7be70 expref: 18 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816728:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748274.816731:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3309:x1875638377015424:12345-0@lo:103: Request processed in 81us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.816742:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748274.816762:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377015680:12345-0@lo:103: Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.816762:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748274.816768:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377015424:0@lo:103: 00000100:00100000:1.0:1788748274.816770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748274.816770:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377015296:12345-0@lo:103: 00010000:00010000:0.0:1788748274.816783:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788748274.816788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788748274.816789:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 15 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748274.816792:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015680:0@lo:103: 00000100:00100000:1.0:1788748274.816798:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee522ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3306:x1875638377015808:12345-0@lo:103: 00010000:00010000:0.0:1788748274.816801:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 15 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816818:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748274.816823:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 15 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816831:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 15 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816831:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7beb6 expref: 15 pid: 5839 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.816841:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7be4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7be46 expref: 14 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.816841:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748274.816848:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748274.816864:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee522ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638377015808:12345-0@lo:103: Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.816864:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:3306:x1875638377015296:12345-0@lo:103: Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748274.816871:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748274.816943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788748274.816950:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015296:0@lo:103: 00000100:00100000:2.0:1788748274.816965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377015808:0@lo:103: 00000100:00100000:2.0:1788748274.818588:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377013888:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748274.818605:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875638377014016:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748274.818655:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.819266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748274.819322:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118400 00000100:00100000:1.0:1788748274.819331:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118400 00010000:00010000:1.0:1788748274.819368:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 10 pid: 5836 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748274.819409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788748274.819420:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2347:x1875638358118400:12345-192.168.203.4@tcp:103: 00010000:00010000:1.0:1788748274.819450:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748274.819456:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 10 pid: 5836 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.819468:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 10 pid: 5836 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.819489:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bf11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521506 expref: 10 pid: 5836 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748274.819505:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748274.819563:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+9:2347:x1875638358118400:12345-192.168.203.4@tcp:103: Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748274.819573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788748274.819633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748274.819708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118528 00000100:00100000:0.0:1788748274.819713:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118528 00010000:00010000:0.0:1788748274.819734:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748274.819773:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748274.819780:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+9:2348:x1875638358118528:12345-192.168.203.4@tcp:103: 00010000:00010000:0.0:1788748274.819787:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748274.819792:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819805:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819824:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4a00/0x5b377f42a7a7bf18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652150d expref: 9 pid: 5839 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819837:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819847:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819873:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819881:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819888:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819896:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819903:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748274.819908:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819917:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819931:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748274.819941:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748274.819965:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+8:2348:x1875638358118528:12345-192.168.203.4@tcp:103: Request processed in 186us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748274.819972:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:2.0:1788748274.821000:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.823512:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748274.823522:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7bf50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.821353:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748275.885555:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748275.885566:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ceecebd000 from 39 10000000:01000000:0.0:1788748275.885573:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748275.885638:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.885669:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.885683:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748275.885712:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377015936:0@lo:101: 00000100:00100000:0.0:1788748275.885813:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.885898:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748275.885994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377015936 00000100:00100000:1.0:1788748275.886004:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377015936 00000100:00100000:1.0:1788748275.886102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788748275.886113:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+12:5841:x1875638377015936:12345-0@lo:101: 00010000:00010000:1.0:1788748275.886131:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748275.886157:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bf5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf57 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.886188:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bf5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf57 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.886201:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bf5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf57 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.886210:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02057200, rc 0) 00000100:00100000:1.0:1788748275.886635:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377015936:12345-0@lo:101: Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.886643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788748275.886796:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377015936:0@lo:101: 00010000:00010000:0.0:1788748275.886828:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.886838:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748275.886910:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016064:0@lo:501: 00000100:00100000:0.0:1788748275.886943:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.887070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016064 00000100:00100000:2.0:1788748275.887076:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016064 00000100:00100000:2.0:1788748275.887118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748275.887127:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377016064:12345-0@lo:501: 00000100:00100000:2.0:1788748275.887817:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377016064:12345-0@lo:501: Request processed in 688us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.887828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788748275.891897:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.891958:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016064:0@lo:501: 00000100:00100000:0.0:1788748275.892112:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016192:0@lo:503: 00000100:00100000:0.0:1788748275.892351:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.892591:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.892725:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016192 00000100:00100000:3.0:1788748275.892735:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016192 00000100:00100000:3.0:1788748275.892811:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748275.892822:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377016192:12345-0@lo:503: 00000100:00100000:3.0:1788748275.893479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:5841:x1875638377016192:12345-0@lo:503: Request processed in 656us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.893490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788748275.893694:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016192:0@lo:503: 00000100:00100000:0.0:1788748275.897789:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8469:1875638377016320:0@lo:502: 00000100:00100000:0.0:1788748275.897917:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.898070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016320 00000100:00100000:2.0:1788748275.898080:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016320 00000100:00100000:2.0:1788748275.898146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788748275.898157:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:8469:x1875638377016320:12345-0@lo:502: 00000100:00100000:2.0:1788748275.898492:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:8469:x1875638377016320:12345-0@lo:502: Request processed in 336us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.898502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788748275.898765:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.898794:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8469:1875638377016320:0@lo:502: 00000100:00100000:0.0:1788748275.898874:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8469:1875638377016448:0@lo:502: 00000100:00100000:0.0:1788748275.898910:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.899000:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.901478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016448 00000100:00100000:3.0:1788748275.901497:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016448 00000100:00100000:3.0:1788748275.901588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788748275.901601:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:8469:x1875638377016448:12345-0@lo:502: 00000100:00100000:3.0:1788748275.902009:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+13:8469:x1875638377016448:12345-0@lo:502: Request processed in 409us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.902536:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8469:1875638377016448:0@lo:502: 00000040:00080000:0.0:1788748275.902585:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788748275.902798:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788748275.902829:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748275.902843:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.902856:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748275.902879:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788748275.902882:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788748275.902885:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788748275.902928:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.902937:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.902947:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748275.902972:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016576:0@lo:101: 00000100:00100000:2.0:1788748275.903254:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.903477:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016576 00000100:00100000:0.0:1788748275.903484:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016576 00000100:00100000:0.0:1788748275.903523:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788748275.903532:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016576:12345-0@lo:101: 00010000:00010000:0.0:1788748275.903547:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748275.903564:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bf6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf65 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.903591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bf6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf65 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.903603:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bf6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf65 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748275.903713:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.903919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00010000:0.0:1788748275.904004:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5200, rc 0) 00000100:00100000:0.0:1788748275.904262:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016576:12345-0@lo:101: Request processed in 729us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.904269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788748275.904445:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016576:0@lo:101: 00010000:00010000:2.0:1788748275.904468:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.904480:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748275.904556:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016704:0@lo:501: 00000100:00100000:2.0:1788748275.904585:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.904618:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123000 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.904686:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016704 00000100:00100000:0.0:1788748275.904703:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016704 00000100:00100000:0.0:1788748275.904741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788748275.904749:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016704:12345-0@lo:501: 00000100:00100000:0.0:1788748275.905649:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016704:12345-0@lo:501: Request processed in 895us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.905660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788748275.905750:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016704:0@lo:501: 00000100:00100000:2.0:1788748275.905812:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016832:0@lo:503: 00000100:00100000:2.0:1788748275.905864:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.905943:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123000 going to sleep for 11 seconds 00000100:00100000:1.0:1788748275.905985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016832 00000100:00100000:1.0:1788748275.905993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016832 00000100:00100000:1.0:1788748275.908757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788748275.908788:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016832:12345-0@lo:503: 00000100:00100000:1.0:1788748275.909175:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377016832:12345-0@lo:503: Request processed in 403us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.909193:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788748275.909216:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377016832:0@lo:503: 00000100:00100000:0.0:1788748275.910316:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8470:1875638377016960:0@lo:502: 00000100:00100000:0.0:1788748275.910383:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.910430:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748275.910451:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377016960 00000100:00100000:2.0:1788748275.910461:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377016960 00000100:00100000:2.0:1788748275.910517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788748275.910528:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8470:x1875638377016960:12345-0@lo:502: 00000100:00100000:2.0:1788748275.910783:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8470:x1875638377016960:12345-0@lo:502: Request processed in 256us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.910791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788748275.910956:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8470:1875638377016960:0@lo:502: 00000020:01000000:0.0:1788748275.910988:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748275.910999:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748275.911002:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748275.911008:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788748275.911230:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8470:1875638377017088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.911442:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.911526:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced35bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.920323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017088 00000100:00100000:3.0:1788748275.920346:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017088 00000100:00100000:3.0:1788748275.920439:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788748275.920454:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8470:x1875638377017088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.920844:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:8470:x1875638377017088:12345-0@lo:502:llog_process_th.0 Request processed in 392us (9570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.920853:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788748275.921534:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8470:1875638377017088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748275.921587:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748275.921598:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748275.921601:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748275.921607:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788748275.921843:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788748275.921867:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788748275.921879:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.921894:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748275.921906:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788748275.921910:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ceecff9800 from 39 10000000:01000000:2.0:1788748275.921913:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788748275.921953:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.921962:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748275.921971:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748275.921997:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.922119:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.922166:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748275.922768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017216 00000100:00100000:1.0:1788748275.922778:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017216 00000100:00100000:1.0:1788748275.922851:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788748275.922863:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:5841:x1875638377017216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748275.922879:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748275.922899:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bf7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.922933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf73 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.922945:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf73 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.922970:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02056600, rc 0) 00000100:00100000:1.0:1788748275.923062:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.923069:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788748275.923124:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748275.923148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.923160:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748275.923231:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.923260:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.923527:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb5099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748275.923751:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017344 00000100:00100000:2.0:1788748275.923757:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017344 00000100:00100000:2.0:1788748275.923811:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788748275.923821:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.924610:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 787us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.924621:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788748275.925492:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.925555:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.925621:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.925663:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb5099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.926562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017472 00000100:00100000:0.0:1788748275.926575:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017472 00000100:00100000:0.0:1788748275.926634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788748275.926644:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.926934:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.926943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788748275.926969:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.936582:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8471:1875638377017600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748275.936710:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.936840:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee51236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.938827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017600 00000100:00100000:3.0:1788748275.938918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017600 00000100:00100000:3.0:1788748275.939011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748275.939040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8471:x1875638377017600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.940047:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8471:x1875638377017600:12345-0@lo:502:llog_process_th.0 Request processed in 978us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.940061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788748275.942318:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8471:1875638377017600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.942455:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8471:1875638377017728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.942541:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.942591:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.943212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017728 00000100:00100000:3.0:1788748275.943223:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017728 00000100:00100000:3.0:1788748275.943393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788748275.943406:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8471:x1875638377017728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.943769:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:8471:x1875638377017728:12345-0@lo:502:llog_process_th.0 Request processed in 365us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.943778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788748275.943904:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8471:1875638377017728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788748275.943945:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788748275.944078:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788748275.944102:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748275.944115:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.944154:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748275.944174:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788748275.944178:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788748275.944182:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748275.944226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.944234:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.944244:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748275.944267:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.944307:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.944347:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb5099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.944429:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017856 00000100:00100000:3.0:1788748275.944436:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017856 00000100:00100000:3.0:1788748275.944478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788748275.944488:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:5841:x1875638377017856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748275.944501:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748275.944517:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43200/0x5b377f42a7a7bf88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf81 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.944543:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43200/0x5b377f42a7a7bf88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf81 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.944566:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43200/0x5b377f42a7a7bf88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf81 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.944575:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43200, rc 0) 00000100:00100000:3.0:1788748275.944618:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377017856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.944625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788748275.945407:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748275.945432:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.945443:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748275.945520:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.945566:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.945620:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb5099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748275.945959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377017984 00000100:00100000:2.0:1788748275.945967:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377017984 00000100:00100000:2.0:1788748275.946036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788748275.946046:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377017984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.946391:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377017984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.946399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788748275.947096:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377017984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.947296:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377018112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.948092:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.948170:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb5099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748275.948171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018112 00000100:00100000:2.0:1788748275.948180:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018112 00000100:00100000:2.0:1788748275.948298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788748275.948309:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377018112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.948563:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377018112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.948577:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788748275.949512:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377018112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748275.949959:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377018368:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.950041:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748275.950129:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377018240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.950262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377018496:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.950296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.950320:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748275.950326:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377018624:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.950348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.950763:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018496 00000100:00100000:2.0:1788748275.950835:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018496 00000100:00100000:2.0:1788748275.950910:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748275.950923:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.950984:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377018496:12345-0@lo:400:kworker.0 Request processed in 66us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.950992:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748275.951054:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.951530:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018368 00000100:00100000:0.0:1788748275.951537:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018368 00000100:00100000:0.0:1788748275.951584:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018624 00000100:00100000:0.0:1788748275.951588:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018624 00000100:00100000:0.0:1788748275.951615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748275.951624:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748275.951685:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377018368:12345-0@lo:400:kworker.0 Request processed in 63us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.951692:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748275.951708:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748275.951715:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377018624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748275.951743:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377018624:12345-0@lo:400:kworker.0 Request processed in 30us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.951749:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748275.951906:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8472:1875638377018880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.951958:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.951987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018880 00000100:00100000:0.0:1788748275.951991:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018880 00000100:00100000:0.0:1788748275.952036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788748275.952043:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8472:x1875638377018880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.952419:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8472:x1875638377018880:12345-0@lo:502:llog_process_th.0 Request processed in 375us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.952425:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788748275.952490:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec34b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.952512:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8472:1875638377018880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748275.952546:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748275.952558:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748275.952560:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748275.952566:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788748275.952591:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8472:1875638377019008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.952626:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.952646:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661480 going to sleep for 11 seconds 00000100:00080000:1.0:1788748275.955378:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748275.955393:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748275.955461:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377018624:0@lo:400:kworker.0 00010000:00080000:1.0:1788748275.955486:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef703b480 x1875638377018496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748275.955498:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377018496:0@lo:400:kworker.0 00000100:00100000:3.0:1788748275.955732:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019008 00000100:00100000:3.0:1788748275.955742:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019008 00000100:00100000:3.0:1788748275.958422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788748275.958442:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8472:x1875638377019008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.958797:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:8472:x1875638377019008:12345-0@lo:502:llog_process_th.0 Request processed in 360us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.958816:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748275.959071:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8472:1875638377019008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748275.959117:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748275.959125:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748275.959128:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748275.959134:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788748275.959212:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788748275.959232:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788748275.959244:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.959257:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748275.959269:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788748275.959291:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec8720800 from 39 10000000:01000000:1.0:1788748275.959295:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748275.959334:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.959344:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748275.959355:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748275.959381:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748275.959425:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.959459:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.959687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019136 00000100:00100000:0.0:1788748275.959695:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019136 00000100:00100000:0.0:1788748275.959727:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788748275.959736:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377019136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748275.959749:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748275.959765:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7bf96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf8f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.959793:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7bf96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf8f expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.959818:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7bf96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf8f expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.959827:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5400, rc 0) 00000100:00100000:0.0:1788748275.959867:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.959874:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788748275.959916:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748275.959942:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.959951:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748275.960005:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960063:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.960077:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.960089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019264 00000100:00100000:0.0:1788748275.960092:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019264 00000100:00100000:0.0:1788748275.960114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788748275.960120:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960399:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.960408:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788748275.960436:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960464:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960497:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.960509:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.960519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019392 00000100:00100000:0.0:1788748275.960522:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019392 00000100:00100000:0.0:1788748275.960537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788748275.960543:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960695:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.960711:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788748275.960746:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.960946:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8473:1875638377019520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.960979:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.960996:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019520 00000100:00100000:0.0:1788748275.961000:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019520 00000100:00100000:0.0:1788748275.961045:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788748275.961052:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8473:x1875638377019520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.961218:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8473:x1875638377019520:12345-0@lo:502:llog_process_th.0 Request processed in 166us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.961225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788748275.961255:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed6616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.961266:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8473:1875638377019520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.961304:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8473:1875638377019648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.961333:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.961350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019648 00000100:00100000:0.0:1788748275.961353:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019648 00000100:00100000:0.0:1788748275.961367:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788748275.961372:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8473:x1875638377019648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748275.961480:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8473:x1875638377019648:12345-0@lo:502:llog_process_th.0 Request processed in 107us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.961486:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788748275.961510:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec849a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.961521:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8473:1875638377019648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788748275.961544:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788748275.961595:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788748275.961609:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748275.961618:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961629:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748275.961639:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788748275.961642:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788748275.961645:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788748275.961668:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961676:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961686:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748275.961699:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.961723:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.961736:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec849a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.961746:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019776 00000100:00100000:0.0:1788748275.961749:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019776 00000100:00100000:0.0:1788748275.961764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788748275.961769:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377019776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748275.961777:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748275.961795:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7bfa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bf9d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961833:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7bfa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf9d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961844:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7bfa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bf9d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961854:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5a00, rc 0) 00000100:00100000:0.0:1788748275.961881:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377019776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.961888:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788748275.961914:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748275.961925:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748275.961934:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748275.961971:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.961993:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.962004:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec849a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.962039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377019904 00000100:00100000:0.0:1788748275.962042:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377019904 00000100:00100000:0.0:1788748275.962057:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788748275.962062:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377019904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.962289:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377019904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.962302:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788748275.962331:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.962355:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.962385:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.962397:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748275.962407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020032 00000100:00100000:0.0:1788748275.962410:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020032 00000100:00100000:0.0:1788748275.962424:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788748275.962429:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377020032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748275.962566:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377020032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.962573:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788748275.962606:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748275.963508:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8474:1875638377020160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.963567:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748275.963598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020160 00000100:00100000:3.0:1788748275.963604:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020160 00000100:00100000:3.0:1788748275.963635:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788748275.963644:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8474:x1875638377020160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.963879:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8474:x1875638377020160:12345-0@lo:502:llog_process_th.0 Request processed in 236us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.963887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788748275.963945:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.963963:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8474:1875638377020160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748275.963988:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748275.963998:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748275.964000:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788748275.964009:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788748275.964065:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8474:1875638377020288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.964096:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748275.964116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020288 00000100:00100000:3.0:1788748275.964120:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020288 00000100:00100000:3.0:1788748275.964140:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788748275.964146:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8474:x1875638377020288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748275.964267:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8474:x1875638377020288:12345-0@lo:502:llog_process_th.0 Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.964274:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788748275.964299:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.964309:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8474:1875638377020288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748275.964324:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748275.964328:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748275.964330:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788748275.964334:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788748275.964395:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788748275.964419:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788748275.964428:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964440:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748275.964461:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788748275.964464:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cee507b380 from 1 10000000:01000000:3.0:1788748275.964467:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748275.964492:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964501:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964510:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748275.964523:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748275.964549:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748275.964563:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.964575:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020416 00000100:00100000:3.0:1788748275.964579:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020416 00000100:00100000:3.0:1788748275.964598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788748275.964604:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377020416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748275.964613:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748275.964627:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bfb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bfab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfab expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964663:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfab expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964684:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42000, rc 0) 00000100:00100000:3.0:1788748275.964713:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377020416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748275.964719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788748275.964747:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748275.964760:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.964770:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748275.964821:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748275.964845:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748275.964856:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748275.964867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020544 00000100:00100000:3.0:1788748275.964870:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020544 00000100:00100000:3.0:1788748275.964888:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788748275.964893:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377020544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748275.965163:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377020544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (317us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788748275.965171:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788748275.965204:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377020544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788748275.965226:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788748275.965232:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748275.965246:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748275.965970:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018240 00000100:00100000:1.0:1788748275.965979:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018240 00000100:00100000:1.0:1788748275.966041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748275.966050:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377018240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748275.966115:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377018240:12345-0@lo:400:kworker.0 Request processed in 68us (15061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.966122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748275.971583:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377018368:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.971675:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377018240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.971689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377018752:0@lo:400:kworker.0 00000100:00100000:2.0:1788748275.971777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748275.971908:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377018752 00000100:00100000:0.0:1788748275.971917:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377018752 00000100:00100000:0.0:1788748275.972007:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748275.972047:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748275.972119:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377018752:12345-0@lo:400:kworker.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748275.972137:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788748275.972332:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788748275.972776:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7038a80 x1875638377018752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748275.972792:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377018752:0@lo:400:kworker.0 00000100:00100000:0.0:1788748276.464731:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748276.464762:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748276.464866:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.465125:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020672 00000100:00100000:1.0:1788748276.465137:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020672 00000100:00100000:1.0:1788748276.465515:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748276.465530:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377020672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748276.465581:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748276.465727:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377020672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.465758:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788748276.465888:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad7100 x1875638377020672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748276.465918:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748276.773299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748276.773354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748276.773401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748276.773434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748276.773468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118656 00000100:00100000:3.0:1788748276.773481:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118656 00000100:00100000:3.0:1788748276.773542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:3.0:1788748276.773554:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:2348:x1875638358118656:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788748276.773765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118784 00000100:00100000:1.0:1788748276.773770:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118784 00000100:00100000:1.0:1788748276.773832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788748276.773841:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358118784:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788748276.773928:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358118784:12345-192.168.203.4@tcp:400: Request processed in 88us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.773936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788748276.773963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119040 00000100:00100000:1.0:1788748276.773966:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119040 00000100:00100000:1.0:1788748276.773991:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358118912 00000100:00100000:1.0:1788748276.773994:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358118912 00000100:00100000:1.0:1788748276.774059:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788748276.774067:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358119040:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788748276.774096:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358119040:12345-192.168.203.4@tcp:400: Request processed in 30us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.774103:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788748276.774115:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748276.774121:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118912:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1788748276.774145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358118912:12345-192.168.203.4@tcp:400: Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.774152:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00080000:1.0:1788748276.774309:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748276.774314:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748276.774316:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748276.776101:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+8:2348:x1875638358118656:12345-192.168.203.4@tcp:400: Request processed in 2534us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.776118:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00010000:00010000:3.0:1788748276.845512:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748276.973572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377020800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748276.973703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.975060:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377020800 00000100:00100000:3.0:1788748276.975084:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377020800 00000100:00100000:3.0:1788748276.975185:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748276.975197:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377020800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748276.975259:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748276.978925:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377020800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3714us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.978971:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788748276.986433:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef703a680 x1875638377020800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748276.986467:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377020800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748277.869688:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748278.374415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748278.374559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119168 00000100:00100000:2.0:1788748278.374574:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119168 00000100:00100000:2.0:1788748278.374646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1788748278.374659:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+8:5591:x1875638358119168:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788748278.374699:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748278.374722:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bfb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee622652156f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748278.374759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652156f expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748278.374772:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652156f expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748278.374794:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d400, rc 0) 00000100:00100000:2.0:1788748278.374875:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119168:12345-192.168.203.4@tcp:101: Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748278.374882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1788748278.384105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.384361:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119296 00000100:00100000:3.0:1788748278.384375:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119296 00000100:00100000:3.0:1788748278.384502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:3.0:1788748278.384516:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119296:12345-192.168.203.4@tcp:501: 00000100:00100000:3.0:1788748278.384953:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119296:12345-192.168.203.4@tcp:501: Request processed in 439us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748278.384963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:1.0:1788748278.393009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.393903:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119424 00000100:00100000:3.0:1788748278.393920:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119424 00000100:00100000:3.0:1788748278.394001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:3.0:1788748278.394038:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119424:12345-192.168.203.4@tcp:503: 00000100:00100000:3.0:1788748278.394600:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119424:12345-192.168.203.4@tcp:503: Request processed in 586us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748278.394611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:0.0:1788748278.404212:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.404405:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119552 00000100:00100000:3.0:1788748278.404419:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119552 00000100:00100000:3.0:1788748278.404493:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:3.0:1788748278.404505:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:6077:x1875638358119552:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788748278.404888:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:6077:x1875638358119552:12345-192.168.203.4@tcp:502: Request processed in 384us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748278.404897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:2.0:1788748278.407886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.407954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119680 00000100:00100000:3.0:1788748278.407969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119680 00000100:00100000:3.0:1788748278.408081:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:3.0:1788748278.408092:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:6077:x1875638358119680:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748278.408634:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:6077:x1875638358119680:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 540us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748278.408644:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:1.0:1788748278.414677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.415220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119808 00000100:00100000:3.0:1788748278.415235:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119808 00000100:00100000:3.0:1788748278.415485:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:3.0:1788748278.415498:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358119808:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748278.415521:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748278.415545:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42c00/0x5b377f42a7a7bfc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748278.415585:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42c00/0x5b377f42a7a7bfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521576 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748278.415600:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42c00/0x5b377f42a7a7bfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521576 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748278.415611:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42c00, rc 0) 00000100:00100000:3.0:1788748278.415689:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358119808:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 194us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748278.415697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1788748278.425381:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748278.425549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358119936 00000100:00100000:3.0:1788748278.425562:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358119936 00000100:00100000:3.0:1788748278.425637:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:3.0:1788748278.425649:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358119936:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748278.426065:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358119936:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 418us (697us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788748278.426073:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00010000:00010000:2.0:1788748278.895062:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748279.921908:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748280.092568:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe4fa9ff0 20000000:00000080:3.0:1788748280.092584:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cef732ec00 uarg=0000000000000000 20000000:01000000:3.0:1788748280.092619:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748280.092624:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748280.092628:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788748280.093426:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788748280.093566:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788748280.098603:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788748280.098659:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788748280.098712:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788748280.098729:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788748280.098747:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098764:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098781:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098788:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098797:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098805:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.098927:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.099320:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 9 pid: 5839 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.099336:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377020928:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748280.099444:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.099453:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 18 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.099462:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021056:0@lo:104: 00000100:00100000:3.0:1788748280.099504:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748280.101465:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.101480:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 18 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.101492:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021184:0@lo:104: 00000100:00100000:3.0:1788748280.101538:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748280.104391:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021056 00000100:00100000:1.0:1788748280.104405:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021056 00000100:00100000:1.0:1788748280.104475:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748280.104485:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:8511:x1875638377021056:12345-0@lo:104: 00010000:00010000:1.0:1788748280.104503:0:7637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748280.104936:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748280.104944:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:8511:x1875638377021056:12345-0@lo:104: Request processed in 462us (5440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748280.104952:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788748280.105140:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748280.105148:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.105158:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748280.105162:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.105170:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748280.105177:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.105497:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.105510:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 18 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.105539:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021312:0@lo:104: 00000100:00100000:2.0:1788748280.105672:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788748280.105692:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748280.105709:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021184 00000100:00100000:2.0:1788748280.105714:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021184 00000100:00100000:2.0:1788748280.105739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021312 00000100:00100000:2.0:1788748280.105741:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021312 00000100:00100000:2.0:1788748280.105751:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748280.105758:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd7e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:8511:x1875638377021184:12345-0@lo:104: 00010000:00010000:2.0:1788748280.105767:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.105932:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748280.105943:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd7e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:8511:x1875638377021184:12345-0@lo:104: Request processed in 186us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748280.105950:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748280.105987:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748280.105992:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:8511:x1875638377021312:12345-0@lo:104: 00010000:00010000:2.0:1788748280.105999:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.106232:0:8511:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748280.106265:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377020928:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748280.106275:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021056:0@lo:104: 00000100:00100000:3.0:1788748280.106282:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021184:0@lo:104: 10000000:01000000:0.0:1788748280.106393:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788748280.106433:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106440:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748280.106461:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106477:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7be62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7be69 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106490:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748280.106500:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106506:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748280.106509:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106517:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748280.106523:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748280.106528:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788748280.106541:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106547:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748280.106562:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106568:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7bd97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.106590:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748280.106592:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748280.106594:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748280.106608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377021440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748280.106893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748280.107082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120064 00000100:00100000:3.0:1788748280.107088:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120064 00010000:00010000:3.0:1788748280.107114:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.107141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1788748280.107150:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2347:x1875638358120064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748280.107161:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748280.107166:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.107177:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.107203:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bf26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652153e expref: 10 pid: 5839 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.107218:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748280.107255:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+9:2347:x1875638358120064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748280.107263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:2.0:1788748280.107886:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748280.107896:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:8511:x1875638377021312:12345-0@lo:104: Request processed in 1902us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748280.107904:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788748280.107927:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748280.107933:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.107941:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748280.107946:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.107955:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748280.107962:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748280.107967:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748280.107993:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.108029:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748280.108040:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.108045:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7bd35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bd3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748280.108060:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748280.108061:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748280.108062:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748280.108067:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748280.108592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748280.108653:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377021568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748280.108697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748280.108718:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748280.108724:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377021696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748280.108742:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748280.108785:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021440 00000100:00100000:0.0:1788748280.108791:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021440 00010000:00010000:0.0:1788748280.108829:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748280.108846:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021568 00000100:00100000:0.0:1788748280.108849:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021568 00010000:00010000:0.0:1788748280.108860:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 20 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748280.108869:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021696 00000100:00100000:0.0:1788748280.108871:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021696 00010000:00010000:0.0:1788748280.108879:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 21 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748280.108890:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748280.108896:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+21:3307:x1875638377021440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748280.108906:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748280.108910:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 21 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.108919:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 21 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.108932:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7be69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7be62 expref: 21 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.108953:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748280.108984:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3307:x1875638377021440:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748280.108990:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748280.109004:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748280.109009:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377021568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748280.109036:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748280.109040:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109048:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109056:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43800/0x5b377f42a7a7bd9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bd97 expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109064:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748280.109087:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3308:x1875638377021568:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748280.109092:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748280.109104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748280.109110:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3308:x1875638377021696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748280.109117:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748280.109121:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 17 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109128:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 17 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109146:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.109155:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.109495:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7bd3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bd35 expref: 17 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748280.109507:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875638377021312:0@lo:104: 00010000:00010000:3.0:1788748280.109538:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.109547:0:8511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748280.109554:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110691:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110705:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110712:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110720:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110727:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748280.110730:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110738:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110750:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110757:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bfc7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748280.110795:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748280.110856:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3308:x1875638377021696:12345-0@lo:103:ldlm_bl.0 Request processed in 1744us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748280.110864:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748280.110922:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377021696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748280.110932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377021568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748280.110962:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377021440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748280.942001:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748281.072818:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377021824:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.072892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.072950:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377022336:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.072977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.073003:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788748281.073010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377021952:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.073029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.073048:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377022464:0@lo:400:kworker.0 00000100:00100000:1.0:1788748281.073060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021824 00000100:00100000:1.0:1788748281.073069:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021824 00000100:00100000:1.0:1788748281.073116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788748281.073126:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377021824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.081705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.081740:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022336 00000100:00100000:1.0:1788748281.081751:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022336 00000100:00100000:1.0:1788748281.081811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377021952 00000100:00100000:1.0:1788748281.081814:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377021952 00000100:00100000:1.0:1788748281.081852:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748281.081863:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377022336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748281.081931:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377022336:12345-0@lo:400:kworker.0 Request processed in 71us (8952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.081937:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748281.081953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748281.081959:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377022080:0@lo:400:kworker.0 00000100:00100000:1.0:1788748281.081961:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377021952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748281.082004:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377021952:12345-0@lo:400:kworker.0 Request processed in 45us (8973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.082034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748281.082040:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.082048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022080 00000100:00100000:1.0:1788748281.082053:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022080 00000100:00100000:3.0:1788748281.082068:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748281.082076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748281.082079:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377022208:0@lo:400:kworker.0 00000100:00100000:1.0:1788748281.082086:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377022080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082118:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.082126:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377022080:12345-0@lo:400:kworker.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.082133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788748281.082161:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748281.082172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377022080:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022464 00000100:00100000:3.0:1788748281.082210:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022464 00000100:00100000:3.0:1788748281.082237:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022208 00000100:00100000:3.0:1788748281.082241:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022208 00000100:00100000:3.0:1788748281.082265:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748281.082272:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377022464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082307:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377022464:12345-0@lo:400:kworker.0 Request processed in 35us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.082314:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748281.082328:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748281.082334:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377022208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082365:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377022208:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.082372:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788748281.082497:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76aad80 x1875638377022208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.082509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377022208:0@lo:400:kworker.0 00010000:00080000:3.0:1788748281.082539:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd966680 x1875638377022464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.082624:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377022464:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082641:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377022336:0@lo:400:kworker.0 00000100:00100000:3.0:1788748281.082662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377021952:0@lo:400:kworker.0 00000100:00080000:1.0:1788748281.082675:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748281.082682:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748281.083147:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377021824:12345-0@lo:400:kworker.0 Request processed in 10021us (10253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.083157:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788748281.083183:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377021824:0@lo:400:kworker.0 10000000:01000000:1.0:1788748281.391578:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748281.391586:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecebd000 from 4 10000000:01000000:1.0:1788748281.391591:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748281.391670:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.391683:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.391715:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.391839:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.391902:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.391951:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed427b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.392108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022592 00000100:00100000:3.0:1788748281.392115:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022592 00000100:00100000:3.0:1788748281.392168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788748281.392178:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377022592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748281.392190:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748281.392203:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bfce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.392225:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.392244:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.392254:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748281.392289:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377022592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.392295:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788748281.392473:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748281.392486:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.392494:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.392540:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.392564:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.392591:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed427b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.393259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022720 00000100:00100000:3.0:1788748281.393266:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022720 00000100:00100000:3.0:1788748281.393297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788748281.393304:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377022720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748281.393536:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377022720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.393543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788748281.395379:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.395446:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.395515:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.395551:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed427b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.395569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022848 00000100:00100000:1.0:1788748281.395575:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022848 00000100:00100000:1.0:1788748281.395937:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788748281.395948:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377022848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.396408:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377022848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 460us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.396423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788748281.397211:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748281.400350:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd966680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8564:1875638377022976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748281.400444:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.400492:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.400589:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377022976 00000100:00100000:1.0:1788748281.400598:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377022976 00000100:00100000:1.0:1788748281.400658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788748281.400668:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8564:x1875638377022976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.400917:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8564:x1875638377022976:12345-0@lo:502:llog_process_th.0 Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.400925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788748281.400980:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd966680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8564:1875638377022976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748281.401042:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748281.401051:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748281.401053:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748281.401061:0:8564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ceecebd000 00000020:00000080:1.0:1788748281.401064:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748281.401138:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8564:1875638377023104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.401172:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.401196:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023104 00000100:00100000:1.0:1788748281.401199:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023104 00000100:00100000:1.0:1788748281.401221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788748281.401227:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8564:x1875638377023104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.401349:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:8564:x1875638377023104:12345-0@lo:502:llog_process_th.0 Request processed in 121us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.401356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788748281.401391:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.401403:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8564:1875638377023104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748281.401428:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748281.401432:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748281.401434:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788748281.401437:0:8564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788748281.401498:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788748281.401513:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748281.401522:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401532:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748281.401542:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748281.401545:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecff9800 from 4 10000000:01000000:1.0:1788748281.401547:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748281.401571:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401578:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401586:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.401598:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.401624:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.401638:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.401650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023232 00000100:00100000:1.0:1788748281.401653:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023232 00000100:00100000:1.0:1788748281.401674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788748281.401679:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377023232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748281.401693:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748281.401717:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bfdc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401740:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401749:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401758:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8200, rc 0) 00000100:00100000:1.0:1788748281.401796:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.401802:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788748281.401834:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748281.401845:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.401853:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.401890:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.401913:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.401924:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.401935:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023360 00000100:00100000:1.0:1788748281.401938:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023360 00000100:00100000:1.0:1788748281.401957:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788748281.401963:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.402222:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.402229:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788748281.402259:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.402285:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.402318:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.402337:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.402347:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023488 00000100:00100000:1.0:1788748281.402350:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023488 00000100:00100000:1.0:1788748281.402370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788748281.402376:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.402485:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.402492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788748281.402528:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.402786:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8565:1875638377023616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.402818:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.402837:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023616 00000100:00100000:1.0:1788748281.402841:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023616 00000100:00100000:1.0:1788748281.402862:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788748281.402867:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8565:x1875638377023616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.402986:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8565:x1875638377023616:12345-0@lo:502:llog_process_th.0 Request processed in 118us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.402994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788748281.403061:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.403073:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8565:1875638377023616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748281.403093:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748281.403101:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748281.403103:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748281.403110:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ceecff9800 00000020:00000080:1.0:1788748281.403113:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748281.403168:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8565:1875638377023744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.403200:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.403219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023744 00000100:00100000:1.0:1788748281.403222:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023744 00000100:00100000:1.0:1788748281.403243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788748281.403249:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8565:x1875638377023744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748281.403353:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:8565:x1875638377023744:12345-0@lo:502:llog_process_th.0 Request processed in 103us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.403360:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788748281.403390:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.403401:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8565:1875638377023744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748281.403417:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748281.403421:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748281.403422:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788748281.403426:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788748281.403463:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788748281.403476:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748281.403483:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403492:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748281.403509:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748281.403512:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec8720800 from 4 10000000:01000000:1.0:1788748281.403515:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748281.403535:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403544:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403551:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.403563:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.403588:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.403601:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.403611:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377023872 00000100:00100000:1.0:1788748281.403614:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377023872 00000100:00100000:1.0:1788748281.403633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788748281.403639:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377023872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748281.403647:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748281.403657:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7bfea expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403676:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403686:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.403705:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748281.403735:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377023872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.403741:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788748281.414856:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377023872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748281.414889:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748281.414903:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.414989:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377024000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.415080:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.415118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024000 00000100:00100000:1.0:1788748281.415125:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024000 00000100:00100000:1.0:1788748281.415347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788748281.415358:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377024000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.415626:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377024000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.415634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788748281.415674:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.415690:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377024000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.415718:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377024128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748281.415754:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.415796:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed79e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.415819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024128 00000100:00100000:0.0:1788748281.415825:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024128 00000100:00100000:0.0:1788748281.415860:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788748281.415870:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377024128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748281.416051:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377024128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.416061:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788748281.416065:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377024128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748281.428515:0:8568:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8568:1875638377024256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748281.428592:0:8568:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.428638:0:8568:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.429924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024256 00000100:00100000:0.0:1788748281.429936:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024256 00000100:00100000:0.0:1788748281.429986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788748281.429996:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:8568:x1875638377024256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748281.430261:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:8568:x1875638377024256:12345-0@lo:502:llog_process_th.0 Request processed in 266us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.430278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788748281.430568:0:8568:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8568:1875638377024256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748281.430602:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748281.430623:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748281.430626:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788748281.430633:0:8568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec8720800 00000020:00000080:2.0:1788748281.430636:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788748281.430731:0:8568:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8568:1875638377024384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748281.430788:0:8568:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.430817:0:8568:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.431292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024384 00000100:00100000:0.0:1788748281.431299:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024384 00000100:00100000:0.0:1788748281.431342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788748281.431350:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:8568:x1875638377024384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748281.431536:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:8568:x1875638377024384:12345-0@lo:502:llog_process_th.0 Request processed in 186us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.431543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788748281.431660:0:8568:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:8568:1875638377024384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748281.431687:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748281.431693:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748281.431694:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788748281.431706:0:8568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788748281.431864:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788748281.431883:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748281.431892:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.431905:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748281.586113:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748281.586137:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748281.586201:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748281.586346:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024512 00000100:00100000:1.0:1788748281.586354:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024512 00000100:00100000:1.0:1788748281.586404:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748281.586412:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377024512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748281.586446:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748281.586491:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377024512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.586498:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788748281.586537:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceeccf5880 x1875638377024512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748281.586557:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748281.893936:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748281.893978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748281.894003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748281.894061:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748281.894086:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120448 00000100:00100000:0.0:1788748281.894096:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120448 00000100:00100000:0.0:1788748281.894147:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120576 00000100:00100000:0.0:1788748281.894150:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120576 00000100:00100000:0.0:1788748281.894185:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788748281.894203:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358120448:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748281.894331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120192 00000100:00100000:2.0:1788748281.894335:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120192 00000100:00100000:2.0:1788748281.894362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:2.0:1788748281.894368:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+9:2349:x1875638358120192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748281.894420:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+9:2349:x1875638358120192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.894427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:2.0:1788748281.894480:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788748281.894488:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358120576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748281.894515:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358120576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.894521:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788748281.894635:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358120448:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 442us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.894656:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00080000:2.0:1788748281.895594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748281.895602:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748281.895616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120320 00000100:00100000:2.0:1788748281.895622:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120320 00000100:00100000:2.0:1788748281.895679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788748281.895687:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358120320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748281.895729:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358120320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.895736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00080000:3.0:1788748281.896098:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748281.960830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748281.960902:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120704 00000100:00100000:3.0:1788748281.960912:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120704 00000100:00100000:3.0:1788748281.960961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:3.0:1788748281.960970:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+9:5591:x1875638358120704:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748281.960986:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748281.961002:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee622652157d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.961056:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.961067:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.961076:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42400, rc 0) 00000100:00100000:3.0:1788748281.961131:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358120704:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 162us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.961138:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00010000:00010000:3.0:1788748281.968221:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748281.979244:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748281.980963:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120832 00000100:00100000:3.0:1788748281.980977:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120832 00000100:00100000:3.0:1788748281.981058:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:3.0:1788748281.981071:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358120832:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748281.981371:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358120832:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 303us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.981389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:1.0:1788748281.990388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748281.990940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358120960 00000100:00100000:3.0:1788748281.990951:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358120960 00000100:00100000:3.0:1788748281.991087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1788748281.991100:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358120960:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748281.991322:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:5591:x1875638358120960:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 224us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.991330:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1788748281.995271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748281.995819:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121088 00000100:00100000:1.0:1788748281.995829:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121088 00000100:00100000:1.0:1788748281.995883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:1.0:1788748281.995891:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:6141:x1875638358121088:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748281.996150:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:6141:x1875638358121088:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 258us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.996157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:3.0:1788748282.004565:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748282.004864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121216 00000100:00100000:0.0:1788748282.004876:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121216 00000100:00100000:0.0:1788748282.004929:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:0.0:1788748282.004941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:6141:x1875638358121216:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748282.006449:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:6141:x1875638358121216:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 1504us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748282.006461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:1.0:1788748282.096441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748282.096522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748282.096614:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024640 00000100:00100000:1.0:1788748282.096622:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024640 00000100:00100000:1.0:1788748282.096670:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748282.096679:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377024640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748282.096725:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748282.097270:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377024640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 591us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748282.097279:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788748282.097326:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7039880 x1875638377024640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748282.097346:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377024640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748282.989274:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748284.017940:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748285.038327:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748286.063945:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748286.114485:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788748286.190833:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377024768:0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.190861:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377025024:0@lo:400:kworker.0 00000100:00100000:0.0:1788748286.190908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748286.190909:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748286.190966:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377025280:0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.190979:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377024896:0@lo:400:kworker.0 00000100:00100000:0.0:1788748286.190995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.191192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.191232:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377025408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.191264:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.191314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025024 00000100:00100000:2.0:1788748286.191322:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025024 00000100:00100000:2.0:1788748286.191382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025280 00000100:00100000:2.0:1788748286.191385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025280 00000100:00100000:2.0:1788748286.191402:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024896 00000100:00100000:2.0:1788748286.191405:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024896 00000100:00100000:1.0:1788748286.191411:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748286.191422:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.191426:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748286.191438:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377025024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.191454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748286.191494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377024768 00000100:00100000:1.0:1788748286.191499:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377024768 00000100:00100000:2.0:1788748286.191504:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377025024:12345-0@lo:400:kworker.0 Request processed in 67us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.191512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748286.191532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788748286.191537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748286.191542:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.191550:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377025280:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788748286.191697:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748286.191724:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025408 00000100:00100000:0.0:1788748286.191742:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025408 00000100:00100000:0.0:1788748286.191778:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025152 00000100:00100000:0.0:1788748286.191781:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025152 00000100:00100000:0.0:1788748286.191806:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748286.191807:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377024768:12345-0@lo:400:kworker.0 Request processed in 264us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748286.191816:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377025408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.191817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788748286.191860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748286.191865:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377025408:12345-0@lo:400:kworker.0 Request processed in 51us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748286.191871:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377024896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748286.191875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748286.191897:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748286.191905:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.191919:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377024896:12345-0@lo:400:kworker.0 Request processed in 51us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748286.191926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748286.191950:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025152:12345-0@lo:400:kworker.0 Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748286.191958:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788748286.191980:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceeccf6d80 x1875638377025152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748286.191995:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025152:0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.192007:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377025024:0@lo:400:kworker.0 00000100:00080000:3.0:1788748286.192111:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748286.192115:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748286.192183:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377025280:12345-0@lo:400:kworker.0 Request processed in 638us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.192190:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748286.192196:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377025280:0@lo:400:kworker.0 00000100:00100000:1.0:1788748286.192208:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377024768:0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.192275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377024896:0@lo:400:kworker.0 00010000:00080000:2.0:1788748286.192289:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceeccf5c00 x1875638377025408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748286.192298:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377025408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748286.701172:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748286.701245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748286.701475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025536 00000100:00100000:3.0:1788748286.701483:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025536 00000100:00100000:3.0:1788748286.701542:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748286.701559:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748286.701593:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748286.701807:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748286.701816:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788748286.701985:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceeccf5180 x1875638377025536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748286.702004:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748287.009454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748287.009494:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748287.009531:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121472 00000100:00100000:1.0:1788748287.009542:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121472 00000100:00100000:3.0:1788748287.009568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748287.009606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748287.009631:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788748287.009642:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358121472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748287.009743:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358121472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748287.009750:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00080000:0.0:1788748287.009797:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748287.009960:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121344 00000100:00100000:3.0:1788748287.009965:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121344 00000100:00100000:3.0:1788748287.010001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:3.0:1788748287.010009:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2347:x1875638358121344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748287.010060:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2347:x1875638358121344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748287.010067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:2.0:1788748287.010176:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121728 00000100:00100000:2.0:1788748287.010181:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121728 00000100:00100000:0.0:1788748287.010286:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121600 00000100:00100000:0.0:1788748287.010292:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121600 00000100:00100000:2.0:1788748287.010310:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748287.010320:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358121728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748287.010360:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358121728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748287.010813:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788748287.010827:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748287.010832:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358121600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748287.010871:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358121600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748287.010879:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:3.0:1788748287.011457:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748287.011463:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788748287.085757:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748287.213360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748287.213384:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748287.213458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748287.213584:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025664 00000100:00100000:2.0:1788748287.213593:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025664 00000100:00100000:2.0:1788748287.213641:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788748287.213651:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748287.213687:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748287.213750:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377025664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748287.213758:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788748287.213837:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef703bb80 x1875638377025664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748287.213854:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377025664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748288.109398:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748289.134591:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748290.157418:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748290.329969:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing yml_node 00010000:00010000:3.0:1788748291.181388:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748291.313539:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377025920:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313650:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377026432:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313712:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788748291.313718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377025792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313770:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377026304:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313817:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377026048:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313837:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313856:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748291.313869:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377026176:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.313891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.313925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025920 00000100:00100000:2.0:1788748291.313932:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025920 00000100:00100000:2.0:1788748291.313969:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026304 00000100:00100000:2.0:1788748291.313972:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026304 00000100:00100000:2.0:1788748291.313992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026048 00000100:00100000:2.0:1788748291.313995:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026048 00000100:00100000:2.0:1788748291.314009:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748291.314044:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377025920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.314093:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377025920:12345-0@lo:400:kworker.0 Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.314099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748291.314117:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788748291.314123:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377026304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.314150:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377026304:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.314155:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748291.314598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377025792 00000100:00100000:1.0:1788748291.314602:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377025792 00000100:00100000:1.0:1788748291.314630:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788748291.314636:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377025792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748291.314671:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377025792:12345-0@lo:400:kworker.0 Request processed in 34us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748291.314686:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788748291.315222:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748291.315231:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377026048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315278:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377026048:12345-0@lo:400:kworker.0 Request processed in 49us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.315283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748291.315302:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026432 00000100:00100000:2.0:1788748291.315306:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026432 00000100:00100000:2.0:1788748291.315333:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026176 00000100:00100000:2.0:1788748291.315335:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026176 00000100:00100000:2.0:1788748291.315353:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748291.315366:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377026432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315397:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377026432:12345-0@lo:400:kworker.0 Request processed in 32us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.315403:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748291.315414:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748291.315419:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315444:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377026176:12345-0@lo:400:kworker.0 Request processed in 26us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.315449:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788748291.315477:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748291.315481:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748291.315483:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788748291.315516:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7039180 x1875638377026176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.315530:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377026176:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315541:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377026048:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315681:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377025792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377026304:0@lo:400:kworker.0 00000100:00100000:2.0:1788748291.315713:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377025920:0@lo:400:kworker.0 00010000:00080000:2.0:1788748291.315723:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad7100 x1875638377026432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.315731:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377026432:0@lo:400:kworker.0 00000100:00100000:1.0:1788748291.821772:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748291.824895:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377026560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748291.824977:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.830840:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026560 00000100:00100000:2.0:1788748291.830872:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026560 00000100:00100000:2.0:1788748291.830991:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748291.831002:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377026560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748291.831055:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748291.831140:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377026560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.831147:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788748291.831230:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb764000 x1875638377026560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748291.831261:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377026560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748292.143752:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748292.143802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748292.143967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121984 00000100:00100000:2.0:1788748292.143978:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121984 00000100:00100000:2.0:1788748292.144070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748292.144080:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358121984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748292.144162:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358121984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748292.144181:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00080000:1.0:1788748292.144384:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748292.145002:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358121856 00000100:00100000:0.0:1788748292.145009:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358121856 00000100:00100000:0.0:1788748292.145076:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:0.0:1788748292.145084:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358121856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748292.145155:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358121856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748292.145162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:1.0:1788748292.145799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748292.145833:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748292.145904:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122112 00000100:00100000:0.0:1788748292.145909:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122112 00000100:00100000:0.0:1788748292.145958:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122240 00000100:00100000:0.0:1788748292.145961:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122240 00000100:00100000:0.0:1788748292.145986:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788748292.145993:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2346:x1875638358122112:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1788748292.146044:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bf34 00000100:00080000:0.0:1788748292.146054:0:6697:0:(import.c:65:import_set_state_nolock()) ffff99cefbb3a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748292.146090:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788748292.146267:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748292.146278:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2346:x1875638358122240:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:2.0:1788748292.146301:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bf3b 00000100:00080000:2.0:1788748292.146309:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cefbb39800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788748292.146344:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788748292.146425:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+2:2346:x1875638358122112:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 430us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748292.146433:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00010000:00010000:0.0:1788748292.146462:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748292.146622:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748292.146624:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+2:2346:x1875638358122240:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 348us (788us total) trans 0 rc 0/0 00000100:00080000:1.0:1788748292.146628:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748292.146636:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00010000:00010000:3.0:1788748292.146904:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748292.205488:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748292.340092:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748292.340114:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377026688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748292.340183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748292.340407:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026688 00000100:00100000:2.0:1788748292.340415:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026688 00000100:00100000:2.0:1788748292.340472:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748292.340482:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377026688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748292.340531:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748292.340598:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377026688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748292.340605:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788748292.340766:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad7100 x1875638377026688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748292.340937:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377026688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788748293.229242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748294.253865:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748294.431562:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:1.0:1788748294.431571:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cefbb3e800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:1.0:1788748294.431598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefbb3e800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-OST0000 00000020:00000080:1.0:1788748294.431639:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefbb3a000 for lustre-OST0000 00000001:02000400:1.0:1788748294.544380:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00010000:00010000:2.0:1788748295.277362:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748296.301263:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748296.431237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377026944:0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.431372:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377027456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.431428:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788748296.431434:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377026816:0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.431482:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377027328:0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431502:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.431533:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026944 00000100:00100000:2.0:1788748296.431540:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026944 00000100:00100000:2.0:1788748296.431649:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027328 00000100:00100000:2.0:1788748296.431653:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027328 00000100:00100000:2.0:1788748296.431696:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788748296.431706:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377026944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431761:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377026944:12345-0@lo:400:kworker.0 Request processed in 56us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.431768:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788748296.431786:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748296.431792:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377027328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431836:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377027328:12345-0@lo:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.431843:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748296.431886:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377027328:0@lo:400:kworker.0 00000100:00100000:2.0:1788748296.431896:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.431981:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377027200:0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.432011:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748296.432061:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748296.432067:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.432088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748296.432115:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377026816 00000100:00100000:1.0:1788748296.432118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377026816 00000100:00100000:1.0:1788748296.432150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788748296.432156:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377026816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.432189:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377026816:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.432195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1788748296.432220:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748296.432967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027072 00000100:00100000:0.0:1788748296.432975:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027072 00000100:00100000:0.0:1788748296.433057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748296.433070:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027456 00000100:00100000:1.0:1788748296.433076:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027456 00000100:00100000:0.0:1788748296.433078:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377027072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.433106:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027200 00000100:00100000:1.0:1788748296.433110:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027200 00000100:00100000:0.0:1788748296.433150:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377027072:12345-0@lo:400:kworker.0 Request processed in 84us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.433157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788748296.433187:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748296.433191:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748296.433204:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748296.433238:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.433405:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748296.433415:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377027456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748296.433451:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377027456:12345-0@lo:400:kworker.0 Request processed in 39us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.434534:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377026816:0@lo:400:kworker.0 00010000:00080000:3.0:1788748296.434555:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb764e00 x1875638377027456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748296.434567:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377027456:0@lo:400:kworker.0 00000100:00100000:0.0:1788748296.436347:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748296.436363:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748296.436375:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377027200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748296.436472:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377027200:12345-0@lo:400:kworker.0 Request processed in 113us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.436481:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788748296.439943:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb766d80 x1875638377027200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748296.439962:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377027200:0@lo:400:kworker.0 00000001:00100000:3.0:1788748296.468624:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:3.0:1788748296.468635:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cefbb3a800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:3.0:1788748296.468661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefbb3a800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-OST0001 00000020:00000080:3.0:1788748296.468715:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefbb39800 for lustre-OST0001 00000100:00100000:0.0:1788748296.948914:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377027584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748296.949007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.949177:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027584 00000100:00100000:0.0:1788748296.949187:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027584 00000100:00100000:0.0:1788748296.949249:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748296.949258:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377027584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748296.949305:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748296.949364:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377027584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.949372:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788748296.949423:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb766d80 x1875638377027584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748296.949446:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377027584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748297.253292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748297.253358:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748297.253401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122368 00000100:00100000:2.0:1788748297.253413:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122368 00000100:00100000:2.0:1788748297.253478:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:2.0:1788748297.253491:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748297.253601:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 112us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748297.253621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:2.0:1788748297.253675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122496 00000100:00100000:2.0:1788748297.253680:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122496 00000100:00100000:2.0:1788748297.253730:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1788748297.253738:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358122496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748297.253776:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358122496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748297.253783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00080000:2.0:1788748297.253947:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748297.325300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748297.360785:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00000100:00100000:2.0:1788748297.454288:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748297.454335:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377027712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748297.454434:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748297.454522:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027712 00000100:00100000:2.0:1788748297.454532:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027712 00000100:00100000:2.0:1788748297.454607:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748297.454618:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377027712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748297.454680:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748297.454730:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377027712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748297.454737:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788748297.454785:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef703b480 x1875638377027712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748297.454804:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377027712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748298.349204:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748299.378068:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748299.940105:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00010000:00010000:2.0:1788748300.397767:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748301.413744:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 22:31:39 EDT 2026 00010000:00010000:2.0:1788748301.422756:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748301.551529:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377027968:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.551620:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377028096:0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.551643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748301.551718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.551746:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748301.551781:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788748301.551787:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377027840:0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.551818:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748301.551825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748301.551862:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377028352:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.551863:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748301.551874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377028224:0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.551891:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748301.551922:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748301.551930:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027968 00000100:00100000:3.0:1788748301.551938:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027968 00000100:00100000:2.0:1788748301.551967:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028096 00000100:00100000:2.0:1788748301.551974:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028096 00000100:00100000:3.0:1788748301.552002:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028352 00000100:00100000:3.0:1788748301.552007:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028352 00000100:00100000:2.0:1788748301.552011:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748301.552042:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377027968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.552058:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788748301.552067:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377028096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.552105:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377027968:12345-0@lo:400:kworker.0 Request processed in 65us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748301.552119:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377028096:12345-0@lo:400:kworker.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748301.552127:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748301.552319:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788748301.552339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748301.552347:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.552381:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377028352:12345-0@lo:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748301.552395:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748301.552416:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028480 00000100:00100000:3.0:1788748301.552419:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028480 00000100:00100000:3.0:1788748301.552453:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028224 00000100:00100000:3.0:1788748301.552457:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028224 00000100:00100000:3.0:1788748301.552478:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748301.552484:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.552517:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377028480:12345-0@lo:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748301.552524:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748301.552537:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748301.552543:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.552570:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377028224:12345-0@lo:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748301.552575:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748301.552660:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377027840 00000100:00100000:3.0:1788748301.552665:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377027840 00000100:00100000:3.0:1788748301.552695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788748301.552701:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377027840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748301.552729:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377027840:12345-0@lo:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748301.552735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1788748301.554865:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748301.554874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748301.554878:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788748301.554927:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd965500 x1875638377028224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.554964:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377028224:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.554981:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377028096:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.555031:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377027840:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.555047:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377028352:0@lo:400:kworker.0 00000100:00100000:2.0:1788748301.555059:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377027968:0@lo:400:kworker.0 00010000:00080000:2.0:1788748301.555071:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd966300 x1875638377028480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.555091:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377028480:0@lo:400:kworker.0 00000100:00100000:1.0:1788748302.061244:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748302.063819:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377028608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748302.063892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748302.065875:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028608 00000100:00100000:2.0:1788748302.065890:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028608 00000100:00100000:2.0:1788748302.065942:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748302.065952:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377028608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748302.065990:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748302.066086:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377028608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748302.066094:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788748302.066829:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb766d80 x1875638377028608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748302.070565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377028608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748302.371733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748302.371823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748302.371950:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122624 00000100:00100000:1.0:1788748302.371960:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122624 00000100:00100000:1.0:1788748302.372034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:1.0:1788748302.372043:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748302.372106:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748302.372125:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:3.0:1788748302.373992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122752 00000100:00100000:3.0:1788748302.374004:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122752 00000100:00080000:2.0:1788748302.376491:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748302.376591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1788748302.376604:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358122752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748302.376700:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358122752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 98us (4976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748302.376707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00010000:00010000:1.0:1788748302.450726:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748302.582746:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377028736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748302.582954:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748302.583703:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028736 00000100:00100000:0.0:1788748302.583715:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028736 00000100:00100000:0.0:1788748302.583956:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748302.583968:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377028736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748302.584008:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748302.587711:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377028736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3736us (4748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748302.587725:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788748302.588513:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5137100 x1875638377028736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748302.588538:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377028736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748303.477371:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748304.502221:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748305.518139:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748306.543124:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748306.669240:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377028864:0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.669327:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377028992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748306.669335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.669372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.669420:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377029504:0@lo:400:kworker.0 00000100:00100000:2.0:1788748306.669423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028864 00000100:00100000:2.0:1788748306.669433:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028864 00000100:00100000:3.0:1788748306.669460:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377029376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.669463:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.669485:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788748306.669496:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.669501:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377029120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.669528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.669557:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748306.669564:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377029248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748306.671427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377028992 00000100:00100000:1.0:1788748306.671441:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377028992 00000100:00100000:1.0:1788748306.671496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029120 00000100:00100000:1.0:1788748306.671499:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029120 00000100:00100000:1.0:1788748306.671532:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788748306.671542:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377028992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748306.671840:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377028864:12345-0@lo:400:kworker.0 Request processed in 2344us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.671850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788748306.671894:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748306.671901:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377029120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748306.671964:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377029120:12345-0@lo:400:kworker.0 Request processed in 64us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.671970:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788748306.672266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.672381:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377028864:0@lo:400:kworker.0 00000100:00100000:3.0:1788748306.672430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029376 00000100:00100000:3.0:1788748306.672434:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029376 00000100:00100000:3.0:1788748306.672461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748306.672467:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377029376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748306.672508:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377029376:12345-0@lo:400:kworker.0 Request processed in 40us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.672514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748306.672605:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377029376:0@lo:400:kworker.0 00000100:00100000:2.0:1788748306.672989:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029504 00000100:00100000:2.0:1788748306.672995:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029504 00000100:00100000:2.0:1788748306.673051:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748306.673059:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377029504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748306.673935:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377029504:12345-0@lo:400:kworker.0 Request processed in 873us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.673954:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788748306.673999:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748306.674030:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748306.674215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.674273:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377029120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.674305:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029248 00000100:00100000:0.0:1788748306.674311:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029248 00000100:00100000:0.0:1788748306.674348:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748306.674356:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748306.674414:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377029248:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.674421:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788748306.674437:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788748306.674458:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb765500 x1875638377029248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.674468:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377029248:0@lo:400:kworker.0 00010000:00080000:3.0:1788748306.674630:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5d180 x1875638377029504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748306.674642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788748306.677480:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377028992:12345-0@lo:400:kworker.0 Request processed in 5931us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.677505:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748306.677745:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377028992:0@lo:400:kworker.0 00000100:00100000:2.0:1788748307.181410:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748307.181435:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377029632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748307.181510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748307.181633:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029632 00000100:00100000:0.0:1788748307.181642:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029632 00000100:00100000:0.0:1788748307.181696:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748307.181706:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377029632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748307.181740:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748307.181786:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377029632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748307.181793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788748307.181875:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5dc00 x1875638377029632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748307.181912:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377029632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748307.491660:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748307.491708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748307.491780:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358122880 00000100:00100000:3.0:1788748307.491789:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358122880 00000100:00100000:3.0:1788748307.491842:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:3.0:1788748307.491852:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748307.491916:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2349:x1875638358122880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748307.491923:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:1.0:1788748307.492264:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123008 00000100:00100000:1.0:1788748307.492269:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123008 00000100:00100000:1.0:1788748307.492318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788748307.492326:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358123008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748307.492365:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358123008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748307.492380:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00080000:3.0:1788748307.492654:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788748307.565794:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748307.693478:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377029760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748307.693551:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748307.694714:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029760 00000100:00100000:1.0:1788748307.694727:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029760 00000100:00100000:1.0:1788748307.694844:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748307.694856:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377029760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748307.694895:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748307.694970:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377029760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748307.694977:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788748307.695102:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5137800 x1875638377029760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748307.695123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377029760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748308.589461:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748309.619275:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748310.637801:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748311.663000:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748311.789832:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377029888:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.789902:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.789950:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377030400:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.789976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.790003:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788748311.790010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377030016:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790064:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.790096:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.790140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377029888 00000100:00100000:3.0:1788748311.790147:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377029888 00000100:00100000:3.0:1788748311.790191:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788748311.790199:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377029888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790248:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377029888:12345-0@lo:400:kworker.0 Request processed in 49us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.790254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788748311.790286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030400 00000100:00100000:3.0:1788748311.790289:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030400 00000100:00100000:3.0:1788748311.790317:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030016 00000100:00100000:3.0:1788748311.790319:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030016 00000100:00100000:3.0:1788748311.790334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788748311.790340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377030400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790368:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377030400:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.790384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788748311.790399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748311.790404:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377030016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790451:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377030016:12345-0@lo:400:kworker.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.790457:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748311.790477:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030528 00000100:00100000:3.0:1788748311.790481:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030528 00000100:00100000:3.0:1788748311.790510:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748311.790516:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377030528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790542:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377030528:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.790547:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788748311.790575:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748311.790579:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748311.790618:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377030016:0@lo:400:kworker.0 00010000:00080000:3.0:1788748311.790631:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76afb80 x1875638377030528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748311.790640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790647:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377029888:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.790654:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377030400:0@lo:400:kworker.0 00000100:00100000:1.0:1788748311.793288:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377030144:0@lo:400:kworker.0 00000100:00100000:1.0:1788748311.793361:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.793405:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748311.793413:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377030272:0@lo:400:kworker.0 00000100:00100000:1.0:1788748311.793454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.795247:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030144 00000100:00100000:3.0:1788748311.795262:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030144 00000100:00100000:3.0:1788748311.795339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788748311.795363:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377030144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748311.795459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030272 00000100:00100000:0.0:1788748311.795470:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030272 00000100:00100000:0.0:1788748311.795503:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748311.795522:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377030272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788748311.795626:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748311.795632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748311.798266:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377030272:12345-0@lo:400:kworker.0 Request processed in 2748us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748311.798281:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788748311.798446:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ae300 x1875638377030272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748311.798464:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788748311.801675:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377030144:12345-0@lo:400:kworker.0 Request processed in 6307us (8305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.801690:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748311.801720:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377030144:0@lo:400:kworker.0 00000100:00100000:3.0:1788748312.301475:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748312.301497:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377030656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748312.301571:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748312.301668:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030656 00000100:00100000:0.0:1788748312.301676:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030656 00000100:00100000:0.0:1788748312.301731:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748312.301740:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377030656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748312.301773:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748312.301827:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377030656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748312.301834:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788748312.301900:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c000 x1875638377030656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748312.301919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377030656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748312.620884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748312.620932:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748312.621001:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123264 00000100:00100000:3.0:1788748312.621011:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123264 00000100:00100000:3.0:1788748312.621103:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:3.0:1788748312.621112:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358123264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748312.621181:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358123264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748312.621188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00080000:0.0:1788748312.621686:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748312.626474:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123136 00000100:00100000:1.0:1788748312.626489:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123136 00000100:00100000:1.0:1788748312.626550:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:1.0:1788748312.626571:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358123136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748312.626648:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+10:2348:x1875638358123136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748312.626656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 203 00010000:00010000:1.0:1788748312.689435:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748312.813244:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377030784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748312.813314:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748312.813474:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030784 00000100:00100000:2.0:1788748312.813485:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030784 00000100:00100000:2.0:1788748312.813540:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748312.813568:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377030784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748312.813603:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748312.813660:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377030784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748312.813667:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788748312.813768:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5137480 x1875638377030784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748312.813787:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377030784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748313.709506:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748314.734172:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748315.214210:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:31:53 (1788748313) === 00000100:00100000:3.0:1788748315.595526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.596061:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123392 00000100:00100000:0.0:1788748315.596081:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123392 00000100:00100000:0.0:1788748315.596166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:0.0:1788748315.596179:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:8134:x1875638358123392:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748315.596231:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748315.596257:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4400/0x5b377f42a7a7bfff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521584 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.596298:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4400/0x5b377f42a7a7bfff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521584 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.596312:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4400/0x5b377f42a7a7bfff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521584 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.596323:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4400, rc 0) 00000100:00100000:0.0:1788748315.596412:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358123392:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 235us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.596491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:1.0:1788748315.600336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.600718:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123520 00000100:00100000:0.0:1788748315.600732:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123520 00000100:00100000:0.0:1788748315.601004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:0.0:1788748315.601065:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358123520:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748315.601492:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358123520:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 475us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.601502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:3.0:1788748315.607697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748315.607966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123648 00000100:00100000:1.0:1788748315.607981:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123648 00000100:00100000:1.0:1788748315.608089:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:1.0:1788748315.608102:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358123648:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788748315.608438:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358123648:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 337us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748315.608447:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:1.0:1788748315.616253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.616586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123776 00000100:00100000:3.0:1788748315.616599:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123776 00000100:00100000:3.0:1788748315.616666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:3.0:1788748315.616677:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+11:8138:x1875638358123776:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748315.617095:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+11:8138:x1875638358123776:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 418us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.617105:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:2.0:1788748315.633838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.633974:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358123904 00000100:00100000:0.0:1788748315.633988:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358123904 00000100:00100000:0.0:1788748315.634299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:0.0:1788748315.634316:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:8138:x1875638358123904:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748315.635278:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:8138:x1875638358123904:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 959us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.635301:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:0.0:1788748315.643729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748315.643851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124032 00000100:00100000:1.0:1788748315.643865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124032 00000100:00100000:1.0:1788748315.643947:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:1.0:1788748315.643961:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+11:8134:x1875638358124032:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748315.643984:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748315.644058:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7c006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215ae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748315.644095:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7c006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748315.644107:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7c006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748315.644121:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8000, rc 0) 00000100:00100000:1.0:1788748315.644208:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:8134:x1875638358124032:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 250us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748315.644232:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:1.0:1788748315.647261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.647368:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124160 00000100:00100000:0.0:1788748315.647381:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124160 00000100:00100000:0.0:1788748315.647442:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:0.0:1788748315.647453:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:8134:x1875638358124160:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788748315.647633:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788748315.647665:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788748315.647670:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788748315.647674:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788748315.647676:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788748315.650356:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:8134:x1875638358124160:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 2887us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.650374:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:3.0:1788748315.653857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.654169:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124288 00000100:00100000:0.0:1788748315.654183:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124288 00000100:00100000:0.0:1788748315.654250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:0.0:1788748315.654261:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+12:8134:x1875638358124288:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748315.654283:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748315.654307:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215b5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.654344:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.654356:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748315.654389:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5c00, rc 0) 00000100:00100000:0.0:1788748315.654464:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:8134:x1875638358124288:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 205us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.654471:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1788748315.656074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.656319:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124416 00000100:00100000:0.0:1788748315.656329:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124416 00000100:00100000:0.0:1788748315.656387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:0.0:1788748315.656396:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:8134:x1875638358124416:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748315.656750:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:8134:x1875638358124416:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 354us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.656760:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:2.0:1788748315.663685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748315.663801:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124544 00000100:00100000:1.0:1788748315.663815:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124544 00000100:00100000:1.0:1788748315.663892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:1.0:1788748315.663904:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:8134:x1875638358124544:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788748315.664675:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:8134:x1875638358124544:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 766us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748315.664686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:1.0:1788748315.668407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.669146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124672 00000100:00100000:3.0:1788748315.669218:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124672 00000100:00100000:3.0:1788748315.669346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:3.0:1788748315.669359:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:8141:x1875638358124672:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748315.669698:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:8141:x1875638358124672:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 342us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.669707:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:1.0:1788748315.679314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.679433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124800 00000100:00100000:0.0:1788748315.679447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124800 00000100:00100000:0.0:1788748315.679532:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:0.0:1788748315.679554:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:8141:x1875638358124800:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748315.679904:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:8141:x1875638358124800:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 352us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.679922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:1.0:1788748315.682975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.683106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125312 00000100:00100000:3.0:1788748315.683119:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125312 00000100:00100000:3.0:1788748315.683215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788748315.683225:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358125312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748315.683304:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358125312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.683312:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00080000:1.0:1788748315.683468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748315.684995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.685119:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358124928 00000100:00100000:3.0:1788748315.685130:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358124928 00000100:00100000:3.0:1788748315.685186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748315.685195:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875638358124928:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788748315.685230:0:5844:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 9dc7f066-3fff-4454-91e9-5eb71e45ae83@192.168.203.4@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788748315.685281:0:5844:0:(genops.c:1384:class_connect()) connect: client 9dc7f066-3fff-4454-91e9-5eb71e45ae83, cookie 0x5b377f42a7a7c014 00000004:00100000:3.0:1788748315.685323:0:5844:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788748315.685696:0:5844:0:(import.c:65:import_set_state_nolock()) ffff99cef746a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748315.685782:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2346:x1875638358124928:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 587us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.685790:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748315.690359:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.690471:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125184 00000100:00100000:3.0:1788748315.690486:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125184 00000100:00100000:3.0:1788748315.690645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748315.690658:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125184:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748315.690717:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788748315.690819:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748315.691276:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125184:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 610us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.691290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748315.701416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748315.701476:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.701548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125056 00000100:00100000:3.0:1788748315.701566:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125056 00000100:00100000:3.0:1788748315.701646:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125440 00000100:00100000:3.0:1788748315.701650:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125440 00000100:00100000:3.0:1788748315.701681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788748315.701692:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+7:0:x1875638358125056:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748315.701722:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788748315.701796:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+7:0:x1875638358125056:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 106us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.701803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788748315.701820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788748315.701826:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125440:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788748315.701856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125440:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.701879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748315.706338:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748315.706547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125824 00000100:00100000:3.0:1788748315.706556:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125824 00000100:00100000:3.0:1788748315.706623:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748315.706634:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125824:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788748315.706712:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748315.706795:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:8134:x1875638358125824:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 162us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748315.706804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788748315.706876:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748315.707082:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748315.707160:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125568 00000100:00100000:0.0:1788748315.707169:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125568 00000100:00100000:0.0:1788748315.707209:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125696 00000100:00100000:0.0:1788748315.707212:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125696 00000100:00100000:0.0:1788748315.707230:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748315.707238:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875638358125568:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788748315.707273:0:6697:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 9dc7f066-3fff-4454-91e9-5eb71e45ae83@192.168.203.4@tcp t0 exp 0000000000000000 cur 232 last 0 00000100:00100000:1.0:1788748315.707306:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748315.707318:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875638358125696:12345-192.168.203.4@tcp:8:mount.lustre.0 00000020:00000080:0.0:1788748315.707332:0:6697:0:(genops.c:1384:class_connect()) connect: client 9dc7f066-3fff-4454-91e9-5eb71e45ae83, cookie 0x5b377f42a7a7c01b 00002000:00100000:0.0:1788748315.707350:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9dc7f066-3fff-4454-91e9-5eb71e45ae83/ffff99cede819800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:1.0:1788748315.707351:0:6695:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 9dc7f066-3fff-4454-91e9-5eb71e45ae83@192.168.203.4@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788748315.707395:0:6695:0:(genops.c:1384:class_connect()) connect: client 9dc7f066-3fff-4454-91e9-5eb71e45ae83, cookie 0x5b377f42a7a7c022 00002000:00100000:0.0:1788748315.707395:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788748315.707413:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9dc7f066-3fff-4454-91e9-5eb71e45ae83/ffff99cefd854800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748315.707441:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788748315.707892:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1788748315.707917:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748315.707953:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99cefd853800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748315.708071:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2346:x1875638358125696:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 754us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748315.708097:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00080000:0.0:1788748315.708871:0:6697:0:(import.c:65:import_set_state_nolock()) ffff99cede818800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748315.708977:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2346:x1875638358125568:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 1735us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.708988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00010000:00010000:1.0:1788748315.760045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788748316.456990:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00010000:00010000:3.0:1788748316.784771:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748316.910060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377030912:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.910153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.910216:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377031424:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.910244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.910277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788748316.910283:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.910304:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.910322:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.910346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.910392:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377031168:0@lo:400:kworker.0 00000100:00100000:2.0:1788748316.910978:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031552 00000100:00100000:2.0:1788748316.910991:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031552 00000100:00100000:2.0:1788748316.911204:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748316.911214:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748316.911295:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377031552:12345-0@lo:400:kworker.0 Request processed in 82us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.911302:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748316.912673:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.912743:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748316.912756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377031296:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.912817:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.912879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377030912 00000100:00100000:1.0:1788748316.912887:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377030912 00000100:00100000:1.0:1788748316.912932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788748316.912940:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377030912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.912990:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377030912:12345-0@lo:400:kworker.0 Request processed in 50us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.912997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788748316.913048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031424 00000100:00100000:1.0:1788748316.913053:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031424 00000100:00100000:1.0:1788748316.913092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031040 00000100:00100000:1.0:1788748316.913096:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031040 00000100:00100000:1.0:1788748316.913108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031168 00000100:00100000:1.0:1788748316.913110:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031168 00000100:00100000:1.0:1788748316.913123:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748316.913141:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377031424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.913177:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377031424:12345-0@lo:400:kworker.0 Request processed in 49us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.913183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748316.913194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788748316.913199:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.913222:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377031040:12345-0@lo:400:kworker.0 Request processed in 24us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.913227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788748316.913236:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748316.913242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377031168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.913274:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377031168:12345-0@lo:400:kworker.0 Request processed in 32us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.913279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748316.913302:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031296 00000100:00100000:1.0:1788748316.913306:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031296 00000100:00100000:1.0:1788748316.913331:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748316.913336:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377031296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.913366:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377031296:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.913371:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788748316.913443:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e0380 x1875638377031296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748316.913465:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377031296:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.913480:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377031168:0@lo:400:kworker.0 00000100:00080000:1.0:1788748316.916218:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748316.916231:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748316.916234:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748316.916307:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377031040:0@lo:400:kworker.0 00010000:00080000:1.0:1788748316.916330:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5225f80 x1875638377031552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748316.916341:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.916354:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377030912:0@lo:400:kworker.0 00000100:00100000:1.0:1788748316.916366:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377031424:0@lo:400:kworker.0 00000001:00100000:0.0:1788748317.001350:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000100:00100000:0.0:1788748317.422562:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748317.422593:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377031680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748317.422683:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748317.422777:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031680 00000100:00100000:0.0:1788748317.422787:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031680 00000100:00100000:0.0:1788748317.422845:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748317.422855:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377031680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748317.422902:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748317.422967:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377031680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748317.422974:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788748317.423076:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c700 x1875638377031680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748317.423097:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377031680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788748317.805463:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748317.934233:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748317.934257:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377031808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748317.934324:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748317.934426:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031808 00000100:00100000:0.0:1788748317.934434:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031808 00000100:00100000:0.0:1788748317.934500:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748317.934510:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377031808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748317.934554:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748317.934600:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377031808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748317.934606:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788748317.934642:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c700 x1875638377031808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748317.934659:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377031808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788748318.834885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748319.854322:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748320.055865:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000100:00100000:2.0:1788748320.809610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748320.809646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748320.809672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748320.809693:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748320.809718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748320.810010:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126208 00000100:00100000:2.0:1788748320.810043:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126208 00000100:00100000:2.0:1788748320.810117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126080 00000100:00100000:2.0:1788748320.810120:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126080 00000100:00100000:2.0:1788748320.810161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:2.0:1788748320.810172:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.810281:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 101us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.810289:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:2.0:1788748320.810309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788748320.810316:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358126080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.810342:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358126080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.810347:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788748320.810368:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126464 00000100:00100000:2.0:1788748320.810371:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126464 00000100:00100000:2.0:1788748320.810398:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126336 00000100:00100000:2.0:1788748320.810402:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126336 00000100:00100000:2.0:1788748320.810425:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788748320.810432:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.810459:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.810483:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788748320.810495:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788748320.810513:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.810539:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358126336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.810545:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00080000:2.0:1788748320.810570:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748320.810574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748320.810577:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748320.812902:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358125952 00000100:00100000:0.0:1788748320.812921:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358125952 00000100:00100000:0.0:1788748320.813005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:0.0:1788748320.813039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358125952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748320.813144:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358125952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 130us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.813153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00010000:00010000:3.0:1788748320.877416:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748321.179126:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788748321.902239:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748322.029841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.029936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.030003:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377032448:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.030088:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748322.030093:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377032064:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.030131:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377032576:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.030186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032448 00000100:00100000:2.0:1788748322.030195:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032448 00000100:00100000:2.0:1788748322.030261:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032064 00000100:00100000:2.0:1788748322.030264:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032064 00000100:00100000:2.0:1788748322.030287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748322.030297:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377032448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030358:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377032448:12345-0@lo:400:kworker.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.030384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748322.030403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748322.030408:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377032064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030437:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377032064:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.030442:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748322.030466:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032576 00000100:00100000:2.0:1788748322.030469:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032576 00000100:00100000:2.0:1788748322.030510:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788748322.030518:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377032576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030550:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377032576:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.030555:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788748322.030571:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748322.030577:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748322.030622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377032064:0@lo:400:kworker.0 00010000:00080000:2.0:1788748322.030637:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb764000 x1875638377032576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748322.030646:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377032576:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.030655:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377032448:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.031097:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377032320:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.031142:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.031173:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748322.031181:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377032192:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.031204:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.031569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032192 00000100:00100000:1.0:1788748322.031578:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032192 00000100:00100000:1.0:1788748322.031628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748322.031635:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377032192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.031693:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377032192:12345-0@lo:400:kworker.0 Request processed in 58us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.031700:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788748322.031721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748322.031744:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377032192:0@lo:400:kworker.0 00000100:00100000:3.0:1788748322.032104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377031936 00000100:00100000:3.0:1788748322.032111:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377031936 00000100:00100000:3.0:1788748322.032151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788748322.032159:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748322.032210:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377031936:12345-0@lo:400:kworker.0 Request processed in 52us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.032216:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788748322.032254:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.032511:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032320 00000100:00100000:2.0:1788748322.032517:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032320 00000100:00100000:2.0:1788748322.032556:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748322.032564:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377032320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.032625:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377032320:12345-0@lo:400:kworker.0 Request processed in 63us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.032633:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788748322.032847:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb765500 x1875638377032320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748322.032859:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377032320:0@lo:400:kworker.0 00000100:00080000:3.0:1788748322.036617:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748322.549230:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377032704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748322.549325:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.549435:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032704 00000100:00100000:1.0:1788748322.549445:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032704 00000100:00100000:1.0:1788748322.549515:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748322.549526:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377032704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748322.549567:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748322.549621:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377032704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.549629:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788748322.549682:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5224a80 x1875638377032704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748322.549704:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377032704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748322.929100:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748323.053344:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748323.053378:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377032832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748323.053474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748323.053700:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032832 00000100:00100000:0.0:1788748323.053712:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032832 00000100:00100000:0.0:1788748323.053779:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748323.053791:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377032832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748323.053839:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748323.053910:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377032832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748323.053917:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788748323.054003:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c700 x1875638377032832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748323.054063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377032832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748323.951194:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748324.974458:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748325.922110:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748325.922156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748325.922191:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748325.922215:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748325.922241:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748325.922273:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127104 00000100:00100000:2.0:1788748325.922285:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127104 00000100:00100000:2.0:1788748325.922359:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126976 00000100:00100000:2.0:1788748325.922363:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126976 00000100:00100000:2.0:1788748325.922388:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748325.922398:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358127104:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.922517:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358127104:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.922524:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748325.922543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788748325.922569:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358126976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.922600:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358126976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.922606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788748325.922628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126848 00000100:00100000:2.0:1788748325.922633:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126848 00000100:00100000:2.0:1788748325.922663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126720 00000100:00100000:2.0:1788748325.922666:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126720 00000100:00100000:2.0:1788748325.922686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788748325.922693:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358126848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.922725:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358126848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.922731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788748325.922744:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1788748325.922751:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358126720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.922775:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358126720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.922781:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00080000:2.0:1788748325.922803:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748325.922808:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748325.922810:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748325.923196:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358126592 00000100:00100000:3.0:1788748325.923203:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358126592 00000100:00100000:3.0:1788748325.923247:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:3.0:1788748325.923256:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358126592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748325.923300:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358126592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748325.923307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00010000:00010000:3.0:1788748325.999627:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748327.021795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748327.149237:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377033216:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.149307:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.149365:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748327.149371:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377033344:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.149397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.149446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033216 00000100:00100000:3.0:1788748327.149454:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033216 00000100:00100000:3.0:1788748327.149519:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748327.149529:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.149581:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377033216:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.149588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748327.149611:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033344 00000100:00100000:3.0:1788748327.149615:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033344 00000100:00100000:3.0:1788748327.149641:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748327.149647:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377033344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.149676:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377033344:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.149689:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788748327.149705:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748327.149723:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748327.149758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb765c00 x1875638377033344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.149772:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377033344:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.149783:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377033216:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150352:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748327.150415:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748327.150493:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788748327.150501:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748327.150550:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748327.150595:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033600 00000100:00100000:1.0:1788748327.150600:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033600 00000100:00100000:1.0:1788748327.150636:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748327.150642:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150679:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377033600:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748327.150684:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748327.150703:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033088 00000100:00100000:1.0:1788748327.150778:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033088 00000100:00100000:1.0:1788748327.150800:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033472 00000100:00100000:1.0:1788748327.150803:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033472 00000100:00100000:1.0:1788748327.150818:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748327.150823:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150853:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377033088:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748327.150858:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748327.150869:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748327.150875:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.150899:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377033472:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748327.150903:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788748327.151329:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748327.151334:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748327.151423:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.151435:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377033088:0@lo:400:kworker.0 00010000:00080000:1.0:1788748327.151447:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76aa680 x1875638377033600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748327.151456:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377033600:0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.151560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377032960 00000100:00100000:0.0:1788748327.151572:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377032960 00000100:00100000:0.0:1788748327.151606:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788748327.151613:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.151659:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377032960:12345-0@lo:400:kworker.0 Request processed in 46us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.151664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788748327.151697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788748327.662176:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748327.662198:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377033728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748327.662267:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748327.662441:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033728 00000100:00100000:0.0:1788748327.662449:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033728 00000100:00100000:0.0:1788748327.662507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748327.662517:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377033728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748327.662556:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748327.662619:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377033728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.662626:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788748327.662665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5224e00 x1875638377033728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748327.662683:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377033728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748328.045200:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748328.174192:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748328.174215:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377033856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748328.174280:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748328.174344:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033856 00000100:00100000:0.0:1788748328.174351:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033856 00000100:00100000:0.0:1788748328.174397:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748328.174405:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377033856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748328.174441:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748328.174505:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377033856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748328.174512:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788748328.174553:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c380 x1875638377033856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748328.174571:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377033856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788748329.073353:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748330.093227:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748331.041638:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748331.041669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748331.041693:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748331.041709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748331.041728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748331.041749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127232 00000100:00100000:3.0:1788748331.041770:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127232 00000100:00100000:3.0:1788748331.041814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1788748331.041823:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358127232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748331.041883:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358127232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748331.041890:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1788748331.041919:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127744 00000100:00100000:3.0:1788748331.041922:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127744 00000100:00100000:3.0:1788748331.041951:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127616 00000100:00100000:3.0:1788748331.041953:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127616 00000100:00100000:3.0:1788748331.041971:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1788748331.041986:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef68ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748331.042044:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef68ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748331.042050:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1788748331.042191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748331.042198:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748331.042221:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748331.042228:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748331.042245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127488 00000100:00100000:3.0:1788748331.042249:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127488 00000100:00100000:3.0:1788748331.042272:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127360 00000100:00100000:3.0:1788748331.042275:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127360 00000100:00100000:3.0:1788748331.042291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788748331.042297:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748331.042322:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358127488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748331.042328:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788748331.042339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1788748331.042345:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358127360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748331.042364:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358127360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748331.042369:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00080000:3.0:1788748331.042518:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748331.042523:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748331.042532:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788748331.117465:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748332.143540:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748332.270133:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377034368:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.270213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.270271:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748332.270278:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377034240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.270316:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.270653:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377033984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.270698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.270723:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377034496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.270743:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.270761:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748332.270767:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377034112:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.270783:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.270796:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377034624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.270812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.270842:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377033984 00000100:00100000:0.0:1788748332.270849:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377033984 00000100:00100000:0.0:1788748332.270887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788748332.270895:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377033984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.270951:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377033984:12345-0@lo:400:kworker.0 Request processed in 57us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.270958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788748332.270988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034240 00000100:00100000:0.0:1788748332.270991:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034240 00000100:00100000:0.0:1788748332.271040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034496 00000100:00100000:0.0:1788748332.271051:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034496 00000100:00100000:0.0:1788748332.271068:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034112 00000100:00100000:0.0:1788748332.271070:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034112 00000100:00100000:0.0:1788748332.271082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748332.271088:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377034240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.271126:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377034240:12345-0@lo:400:kworker.0 Request processed in 37us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.271132:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788748332.271396:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034368 00000100:00100000:3.0:1788748332.271402:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034368 00000100:00100000:3.0:1788748332.271443:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034624 00000100:00100000:3.0:1788748332.271446:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034624 00000100:00100000:3.0:1788748332.271468:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788748332.271475:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.271512:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377034368:12345-0@lo:400:kworker.0 Request processed in 38us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.271517:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788748332.271528:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748332.271533:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377034624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.271558:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377034624:12345-0@lo:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.271563:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748332.271580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788748332.271587:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377034496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.271614:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377034496:12345-0@lo:400:kworker.0 Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.271619:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788748332.271633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788748332.271638:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.271662:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377034112:12345-0@lo:400:kworker.0 Request processed in 24us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.271668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748332.271789:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377034112:0@lo:400:kworker.0 00010000:00080000:0.0:1788748332.271803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5136680 x1875638377034624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.271812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377034624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.271821:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377033984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.271829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377034496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.271863:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377034240:0@lo:400:kworker.0 00010000:00080000:0.0:1788748332.271872:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5135500 x1875638377034368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.271881:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377034368:0@lo:400:kworker.0 00000100:00080000:3.0:1788748332.273404:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748332.273432:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748332.273436:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748332.781235:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377034752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748332.781302:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.781436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034752 00000100:00100000:0.0:1788748332.781446:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034752 00000100:00100000:0.0:1788748332.781501:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748332.781511:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377034752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748332.781548:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748332.781714:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377034752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.781731:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788748332.781822:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5d880 x1875638377034752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748332.781841:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377034752:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788748333.166476:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748333.293343:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748333.293370:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377034880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748333.293455:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748333.293631:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377034880 00000100:00100000:0.0:1788748333.293640:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377034880 00000100:00100000:0.0:1788748333.293697:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748333.293706:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377034880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748333.293742:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748333.293799:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377034880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748333.293806:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788748333.294006:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5ea00 x1875638377034880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748333.294058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377034880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748334.191507:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748335.217363:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748336.162672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748336.162768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358127872 00000100:00100000:3.0:1788748336.162779:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358127872 00000100:00100000:3.0:1788748336.162835:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:3.0:1788748336.162847:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358127872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748336.162922:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358127872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748336.162929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:0.0:1788748336.166568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748336.166710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128000 00000100:00100000:3.0:1788748336.166719:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128000 00000100:00100000:3.0:1788748336.166863:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788748336.166874:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358128000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748336.166957:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358128000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 86us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748336.166964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00080000:0.0:1788748336.167050:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748336.173846:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748336.173889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748336.173969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748336.174062:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128256 00000100:00100000:2.0:1788748336.174073:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128256 00000100:00100000:2.0:1788748336.174136:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128384 00000100:00100000:2.0:1788748336.174149:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128384 00000100:00100000:2.0:1788748336.174185:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748336.174196:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2346:x1875638358128256:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:2.0:1788748336.174228:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c01b 00000100:00080000:2.0:1788748336.174236:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cede818800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788748336.174277:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788748336.174621:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+2:2346:x1875638358128256:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 426us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748336.174629:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748336.174646:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748336.174665:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2346:x1875638358128384:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:2.0:1788748336.174679:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c022 00000100:00080000:2.0:1788748336.174685:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cefd853800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788748336.174705:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788748336.174891:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+2:2346:x1875638358128384:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 226us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748336.174898:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788748336.175185:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128128 00000100:00100000:0.0:1788748336.175192:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128128 00000100:00100000:0.0:1788748336.175236:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1788748336.175244:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358128128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748336.175285:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358128128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748336.175291:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00010000:00010000:3.0:1788748336.175625:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748336.175764:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748336.175772:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748336.175778:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748336.175781:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788748336.244739:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748337.263314:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748337.390094:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377035008:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390164:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390208:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377035520:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390257:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748337.390263:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377035136:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390344:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377035648:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390365:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390400:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377035264:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390420:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390435:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748337.390440:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035392:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390456:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.390479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035008 00000100:00100000:0.0:1788748337.390485:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035008 00000100:00100000:0.0:1788748337.390518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788748337.390525:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377035008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390567:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377035008:12345-0@lo:400:kworker.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390573:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788748337.390601:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035648 00000100:00100000:0.0:1788748337.390604:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035648 00000100:00100000:0.0:1788748337.390628:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035392 00000100:00100000:0.0:1788748337.390631:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035392 00000100:00100000:0.0:1788748337.390647:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748337.390653:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390683:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377035648:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390688:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748337.390700:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748337.390705:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390744:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035392:12345-0@lo:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390751:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748337.390768:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035520 00000100:00100000:0.0:1788748337.390772:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035520 00000100:00100000:0.0:1788748337.390793:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035136 00000100:00100000:0.0:1788748337.390795:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035136 00000100:00100000:0.0:1788748337.390805:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035264 00000100:00100000:0.0:1788748337.390807:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035264 00000100:00100000:0.0:1788748337.390820:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748337.390826:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390854:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377035520:12345-0@lo:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390859:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748337.390870:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788748337.390875:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377035136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390898:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377035136:12345-0@lo:400:kworker.0 Request processed in 23us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390903:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788748337.390913:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788748337.390918:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377035264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.390938:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377035264:12345-0@lo:400:kworker.0 Request processed in 20us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.390942:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788748337.390971:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5c700 x1875638377035392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.390995:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035392:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.391006:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377035264:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.391055:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377035136:0@lo:400:kworker.0 00010000:00080000:0.0:1788748337.391063:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceece5dc00 x1875638377035648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.391071:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377035648:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.391078:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377035008:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.391086:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceece5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377035520:0@lo:400:kworker.0 00000100:00080000:1.0:1788748337.391951:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748337.391958:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748337.391960:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788748337.421503:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000020:00000080:3.0:1788748337.421513:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cefd854800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000020:00000080:0.0:1788748337.421793:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd854800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 for lustre-OST0001 00000020:00000080:0.0:1788748337.421872:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd853800 for lustre-OST0001 00000100:00100000:2.0:1788748337.903260:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748337.903327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.903627:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035776 00000100:00100000:0.0:1788748337.903635:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035776 00000100:00100000:0.0:1788748337.903689:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748337.903699:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748337.903731:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748337.903787:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.903795:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788748337.903909:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd961f80 x1875638377035776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748337.903927:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748338.285313:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748338.413266:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748338.413291:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748338.413638:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748338.413705:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377035904 00000100:00100000:2.0:1788748338.413720:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377035904 00000100:00100000:2.0:1788748338.413800:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748338.413813:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748338.413865:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748338.414506:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377035904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 692us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748338.414530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788748338.414564:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd960700 x1875638377035904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748338.414596:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377035904:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788748338.954622:0:11024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788748339.310968:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748340.336889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748340.542860:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000020:00000080:1.0:1788748340.542875:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cede819800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000020:00000080:3.0:1788748340.542972:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cede819800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 for lustre-OST0000 00000020:00000080:3.0:1788748340.543070:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cede818800 for lustre-OST0000 00000100:00100000:1.0:1788748341.283743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748341.283814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748341.283852:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748341.283888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128768 00000100:00100000:1.0:1788748341.283901:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128768 00000100:00100000:2.0:1788748341.283906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128512 00000100:00100000:2.0:1788748341.283910:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128512 00000100:00100000:1.0:1788748341.283957:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128640 00000100:00100000:1.0:1788748341.283960:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128640 00000100:00100000:2.0:1788748341.283963:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:1.0:1788748341.283980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1788748341.283981:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358128512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748341.283986:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358128768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748341.284094:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:3.0:1788748341.284104:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358128640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748341.284274:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358128512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 293us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748341.284274:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358128768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 285us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748341.284282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00080000:1.0:1788748341.284308:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748341.284795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:3.0:1788748341.288163:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358128640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 4041us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748341.288188:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00010000:00010000:0.0:1788748341.358121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748342.388341:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748342.511004:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377036032:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511106:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.511166:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377036544:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.511525:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788748342.511531:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377036160:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511553:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.511571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511593:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.511696:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377036288:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.511732:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748342.511736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377036416:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.511766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.512130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036032 00000100:00100000:1.0:1788748342.512140:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036032 00000100:00100000:1.0:1788748342.512191:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788748342.512209:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377036032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.512382:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377036032:12345-0@lo:400:kworker.0 Request processed in 182us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.512390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788748342.512418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036544 00000100:00100000:1.0:1788748342.512421:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036544 00000100:00100000:1.0:1788748342.512448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036160 00000100:00100000:1.0:1788748342.512450:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036160 00000100:00100000:1.0:1788748342.512458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036288 00000100:00100000:1.0:1788748342.512460:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036288 00000100:00100000:1.0:1788748342.512477:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788748342.512482:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.512509:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377036544:12345-0@lo:400:kworker.0 Request processed in 28us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.512514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788748342.512523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748342.512528:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377036160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.512981:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377036160:12345-0@lo:400:kworker.0 Request processed in 451us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.512988:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748342.513000:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788748342.513006:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377036288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513059:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377036288:12345-0@lo:400:kworker.0 Request processed in 53us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.513074:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788748342.513095:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036672 00000100:00100000:1.0:1788748342.513099:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036672 00000100:00100000:1.0:1788748342.513122:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377036416 00000100:00100000:1.0:1788748342.513125:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377036416 00000100:00100000:1.0:1788748342.513142:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748342.513148:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513180:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377036672:12345-0@lo:400:kworker.0 Request processed in 32us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.513186:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748342.513374:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377036288:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513731:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748342.513741:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377036416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513777:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377036416:12345-0@lo:400:kworker.0 Request processed in 39us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.513783:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788748342.513805:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748342.513808:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748342.513810:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788748342.513847:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5226a00 x1875638377036416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748342.513859:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377036416:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513885:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377036160:0@lo:400:kworker.0 00010000:00080000:1.0:1788748342.513894:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee50e2300 x1875638377036672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748342.513902:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513920:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377036032:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.513931:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377036544:0@lo:400:kworker.0 00000020:00000080:0.0:1788748342.543651:0:11172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc50764870 20000000:00000080:0.0:1788748342.543666:0:11172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cef7531000 uarg=0000000000000000 20000000:01000000:0.0:1788748342.543693:0:11172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788748342.543697:0:11172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788748342.543700:0:11172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788748342.544562:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788748342.544770:0:11172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788748342.549868:0:11172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788748342.550093:0:11172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550114:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550122:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550129:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550138:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550144:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550151:0:11172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550196:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550249:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 12 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.550266:0:11172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377036800:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748342.550452:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550463:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.550471:0:11172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd963800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377036928:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748342.550505:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550513:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.550521:0:11172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd963480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037056:0@lo:104: 00000100:00100000:0.0:1788748342.550557:0:11172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748342.550599:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550607:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.550614:0:11172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037184:0@lo:104: 00000100:00100000:0.0:1788748342.550632:0:11172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748342.550667:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.550675:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.550682:0:11172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037312:0@lo:104: 00000100:00100000:0.0:1788748342.550700:0:11172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748342.550715:0:11172:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748342.550796:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037056 00000100:00100000:2.0:1788748342.550804:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037056 00000100:00100000:2.0:1788748342.550852:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037184 00000100:00100000:2.0:1788748342.550855:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037184 00000100:00100000:2.0:1788748342.550864:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037312 00000100:00100000:2.0:1788748342.550866:0:7637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037312 00000100:00100000:2.0:1788748342.550877:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748342.550884:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:11172:x1875638377037056:12345-0@lo:104: 00010000:00010000:2.0:1788748342.550897:0:7637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.550950:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748342.550955:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+5:11172:x1875638377037056:12345-0@lo:104: Request processed in 72us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.550961:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748342.550977:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748342.550982:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:11172:x1875638377037184:12345-0@lo:104: 00010000:00010000:2.0:1788748342.550989:0:7637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551052:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788748342.551058:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:11172:x1875638377037184:12345-0@lo:104: Request processed in 76us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.551065:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748342.551077:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748342.551083:0:7637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11172:x1875638377037312:12345-0@lo:104: 00010000:00010000:2.0:1788748342.551090:0:7637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551120:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788748342.551140:0:7637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11172:x1875638377037312:12345-0@lo:104: Request processed in 44us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.551146:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788748342.551166:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748342.551171:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551179:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748342.551183:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551191:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748342.551199:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748342.551205:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748342.551238:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551245:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748342.551264:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551270:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9000/0x5b377f42a7a7bfea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bff1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551280:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748342.551283:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551287:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748342.551290:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551296:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748342.551302:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748342.551307:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748342.551319:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551324:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748342.551329:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551345:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02056a00/0x5b377f42a7a7bfdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfe3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551367:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748342.551370:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551376:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748342.551379:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551386:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748342.551392:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748342.551397:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748342.551412:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551417:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748342.551433:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551441:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7bfce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7bfd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.551446:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748342.551455:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748342.551460:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377037440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748342.551466:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748342.551470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748342.551477:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748342.551496:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.551536:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748342.551542:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377037568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748342.551570:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.551603:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377037696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748342.551642:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037440 00000100:00100000:2.0:1788748342.551648:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037440 00000100:00100000:1.0:1788748342.551654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748342.551668:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 19 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748342.551693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037568 00000100:00100000:2.0:1788748342.551696:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037568 00010000:00010000:2.0:1788748342.551706:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 20 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748342.551712:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037696 00000100:00100000:1.0:1788748342.551718:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037696 00000100:00100000:2.0:1788748342.551722:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748342.551732:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee522b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+21:3308:x1875638377037440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748342.551743:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748342.551747:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551755:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551770:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748342.551798:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee522b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+21:3308:x1875638377037440:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.551805:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748342.551839:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748342.551845:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3308:x1875638377037568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748342.551851:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748342.551855:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 20 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551869:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 20 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.551878:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748342.551899:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3308:x1875638377037568:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.551904:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788748342.552375:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7bff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bfea expref: 19 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748342.552387:0:11172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd963480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037056:0@lo:104: 00010000:00010000:3.0:1788748342.552399:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7bfe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bfdc expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748342.552407:0:11172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037184:0@lo:104: 00000100:00100000:3.0:1788748342.552414:0:11172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377037312:0@lo:104: 00000100:00100000:0.0:1788748342.552978:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377037568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748342.552989:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377037440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748342.555094:0:11172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377036800:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748342.555165:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748342.555319:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748342.555332:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3306:x1875638377037696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748342.555349:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748342.555366:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.555377:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.555395:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43a00/0x5b377f42a7a7bfd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7bfce expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748342.555409:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748342.555464:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3306:x1875638377037696:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.555472:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748342.555536:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377037696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748342.555810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748342.555859:0:11172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd963800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875638377036928:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748342.555888:0:11172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748342.556711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748342.556914:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358128896 00000100:00100000:2.0:1788748342.556923:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358128896 00010000:00010000:2.0:1788748342.556959:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748342.556989:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788748342.556998:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358128896:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748342.557010:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748342.557033:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.557044:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.557060:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5c00/0x5b377f42a7a7c00d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215b5 expref: 13 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748342.557072:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748342.557124:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+12:2347:x1875638358128896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 127us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.557146:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1788748342.558496:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129024 00000100:00100000:1.0:1788748342.558506:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129024 00010000:00010000:1.0:1788748342.558532:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748342.558594:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788748342.558612:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+12:2347:x1875638358129024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748342.558625:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748342.558630:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558640:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558653:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7bff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652157d expref: 12 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558667:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558676:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558691:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558699:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558706:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558713:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558720:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748342.558724:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558738:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558770:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748342.558782:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748342.558853:0:11172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748342.558861:0:11172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748342.558868:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7c029 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748342.558931:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+11:2347:x1875638358129024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 320us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.558939:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1788748343.021386:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748343.021409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377037824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748343.021488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748343.021712:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037824 00000100:00100000:0.0:1788748343.021733:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037824 00000100:00100000:0.0:1788748343.021799:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748343.021808:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377037824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748343.021849:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748343.021892:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377037824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748343.021899:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788748343.022228:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd961500 x1875638377037824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748343.022248:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377037824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748343.405359:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748343.533406:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748343.533429:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377037952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748343.533495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748343.533689:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377037952 00000100:00100000:0.0:1788748343.533698:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377037952 00000100:00100000:0.0:1788748343.533761:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748343.533771:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377037952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748343.533810:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748343.533863:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377037952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748343.533869:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788748343.534140:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd962d80 x1875638377037952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748343.534158:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377037952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748343.718967:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748343.719002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129152 00000100:00100000:2.0:1788748343.719038:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129152 00000100:00100000:2.0:1788748343.719087:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:2.0:1788748343.719097:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:5591:x1875638358129152:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748343.719114:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748343.719132:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215df expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.719159:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.719171:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.719180:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d200, rc 0) 00000100:00100000:2.0:1788748343.719228:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129152:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748343.719235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:3.0:1788748343.725367:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748343.727233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129280 00000100:00100000:2.0:1788748343.727249:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129280 00000100:00100000:2.0:1788748343.727325:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:2.0:1788748343.727335:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129280:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748343.727644:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129280:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 310us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748343.727652:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:3.0:1788748343.732466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748343.732729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129408 00000100:00100000:1.0:1788748343.732738:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129408 00000100:00100000:1.0:1788748343.732985:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:1.0:1788748343.732996:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129408:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748343.733249:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129408:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 254us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748343.733257:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:3.0:1788748343.740460:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748343.740533:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129536 00000100:00100000:2.0:1788748343.740542:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129536 00000100:00100000:2.0:1788748343.740591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:2.0:1788748343.740808:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358129536:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748343.740829:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748343.740846:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.740873:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.740884:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748343.740892:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d600, rc 0) 00000100:00100000:2.0:1788748343.740951:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358129536:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 351us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748343.740958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:2.0:1788748343.743409:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748343.746311:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129664 00000100:00100000:1.0:1788748343.746326:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129664 00000100:00100000:1.0:1788748343.746402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:1.0:1788748343.746413:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358129664:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748343.746708:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358129664:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 295us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748343.746715:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:3.0:1788748343.749268:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748343.749489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129792 00000100:00100000:2.0:1788748343.749520:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129792 00000100:00100000:2.0:1788748343.749573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:2.0:1788748343.749584:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358129792:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748343.750121:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358129792:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 537us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748343.750130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 10000000:01000000:2.0:1788748344.302425:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748344.302430:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecebd000 from 7 10000000:01000000:2.0:1788748344.302435:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748344.302475:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.302485:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.302496:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748344.302521:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748344.302580:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748344.302701:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748344.302833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038080 00000100:00100000:0.0:1788748344.302840:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038080 00000100:00100000:0.0:1788748344.302895:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788748344.302905:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377038080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748344.302917:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748344.302930:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c03e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.302951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.302961:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.302980:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748344.303050:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748344.303057:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788748344.303191:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748344.303205:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.303214:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748344.303265:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.303292:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748344.303321:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748344.303365:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038208 00000100:00100000:2.0:1788748344.303370:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038208 00000100:00100000:2.0:1788748344.303431:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788748344.303438:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748344.303664:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748344.303671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788748344.303729:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.303769:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.303802:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748344.303934:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748344.303964:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038336 00000100:00100000:0.0:1788748344.303969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038336 00000100:00100000:0.0:1788748344.303990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788748344.303996:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748344.304262:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748344.304269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788748344.305775:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748344.306634:0:11255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788748344.306836:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788748344.306860:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748344.306871:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.306882:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748344.306903:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748344.306906:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecff9800 from 7 10000000:01000000:3.0:1788748344.306908:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748344.306941:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.306948:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.306958:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748344.306980:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.307095:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748344.307171:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748344.307252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038464 00000100:00100000:2.0:1788748344.307259:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038464 00000100:00100000:2.0:1788748344.307329:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788748344.307339:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377038464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748344.307371:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748344.307385:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c04c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.307410:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.307421:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.307430:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147ce00, rc 0) 00000100:00100000:2.0:1788748344.307510:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748344.307517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788748344.307620:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748344.307634:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.307643:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748344.307689:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.307715:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748344.307832:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038592 00000100:00100000:0.0:1788748344.307838:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038592 00000100:00100000:0.0:1788748344.307870:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788748344.307879:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.308203:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748344.308407:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748344.308414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788748344.308481:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.308512:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.308555:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748344.308576:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748344.308620:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038720 00000100:00100000:2.0:1788748344.308625:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038720 00000100:00100000:2.0:1788748344.308658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788748344.308665:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748344.308890:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748344.308898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788748344.308974:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788748344.309916:0:11256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788748344.310299:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788748344.310321:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748344.310332:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.310410:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748344.310424:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748344.310426:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec8720800 from 7 10000000:01000000:2.0:1788748344.310428:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748344.310462:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.310469:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748344.310479:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748344.310501:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748344.310551:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748344.310590:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748344.310646:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038848 00000100:00100000:0.0:1788748344.310653:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038848 00000100:00100000:0.0:1788748344.310696:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788748344.310704:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377038848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748344.310716:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748344.310728:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c05a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.310831:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.310841:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748344.310849:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4000, rc 0) 00000100:00100000:0.0:1788748344.310895:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377038848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748344.310902:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788748344.311009:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748344.311048:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.311057:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748344.311105:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748344.311131:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748344.311153:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748344.311203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377038976 00000100:00100000:0.0:1788748344.311208:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377038976 00000100:00100000:0.0:1788748344.311230:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788748344.311237:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377038976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748344.311483:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377038976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748344.311489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788748344.311712:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748344.311750:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7317100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377039104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748344.311785:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748344.311808:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee51230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748344.311849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039104 00000100:00100000:2.0:1788748344.311854:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039104 00000100:00100000:2.0:1788748344.311880:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788748344.311886:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377039104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748344.312079:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377039104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748344.312086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788748344.312174:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7317100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377039104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748344.313109:0:11257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788748344.313421:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788748344.313440:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748344.313448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748344.313459:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748344.429318:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748345.453239:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748346.199917:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788748346.405108:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748346.405152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748346.405178:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748346.405206:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358129920 00000100:00100000:3.0:1788748346.405217:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358129920 00000100:00100000:3.0:1788748346.405263:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1788748346.405273:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358129920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.405352:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358129920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.405361:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1788748346.405527:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130176 00000100:00100000:3.0:1788748346.405539:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130176 00000100:00100000:3.0:1788748346.405584:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130048 00000100:00100000:3.0:1788748346.405587:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130048 00000100:00100000:3.0:1788748346.405607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788748346.405613:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358130176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.405644:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358130176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.405650:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788748346.405660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:3.0:1788748346.405666:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358130048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.405689:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358130048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.405694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00080000:0.0:1788748346.405740:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748346.477262:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748347.501219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748347.632284:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748347.632331:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377039232:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.632439:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377039744:0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.632439:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748347.632465:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377039360:0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.633180:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377039616:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.633685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.633810:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377039488:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.633848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.633885:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039488 00000100:00100000:0.0:1788748347.633895:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039488 00000100:00100000:0.0:1788748347.633978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788748347.633989:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377039488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.634073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039744 00000100:00100000:2.0:1788748347.634079:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039744 00000100:00100000:0.0:1788748347.634096:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377039488:12345-0@lo:400:kworker.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.634118:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748347.634127:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.634169:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377039744:12345-0@lo:400:kworker.0 Request processed in 44us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.634554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788748347.634637:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748347.634684:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377039488:0@lo:400:kworker.0 00000100:00100000:3.0:1788748347.636881:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748347.637065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.637105:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748347.637265:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377039872:0@lo:400:kworker.0 00000100:00100000:3.0:1788748347.637750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.637793:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039360 00000100:00100000:2.0:1788748347.637805:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039360 00000100:00100000:2.0:1788748347.637856:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748347.637865:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377039744:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.637870:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377039360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.637943:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377039360:12345-0@lo:400:kworker.0 Request processed in 78us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.637949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748347.637997:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377039360:0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.638875:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039232 00000100:00100000:1.0:1788748347.638887:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039232 00000100:00100000:0.0:1788748347.638916:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039616 00000100:00100000:0.0:1788748347.638925:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039616 00000100:00100000:0.0:1788748347.638986:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377039872 00000100:00100000:0.0:1788748347.638990:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377039872 00000100:00100000:0.0:1788748347.639031:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748347.639042:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377039616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.639113:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377039616:12345-0@lo:400:kworker.0 Request processed in 74us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.639121:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788748347.639146:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748347.639150:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788748347.639153:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748347.639160:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377039872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.639412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788748347.639423:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377039232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.639468:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377039232:12345-0@lo:400:kworker.0 Request processed in 48us (7032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748347.639475:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:1.0:1788748347.639725:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5227480 x1875638377039616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748347.639760:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377039616:0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.639775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377039232:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.640498:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377039872:12345-0@lo:400:kworker.0 Request processed in 1335us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.640509:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788748347.643168:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5224000 x1875638377039872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748347.643193:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377039872:0@lo:400:kworker.0 00000100:00100000:3.0:1788748348.143748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748348.143780:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceeccf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377040000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748348.143868:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748348.144202:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040000 00000100:00100000:2.0:1788748348.144213:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040000 00000100:00100000:2.0:1788748348.144282:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748348.144293:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377040000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748348.144353:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748348.144419:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377040000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748348.144427:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788748348.144596:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceeccf4700 x1875638377040000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748348.144618:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceeccf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377040000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788748348.528050:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748348.653601:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748348.653632:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377040128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748348.653727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748348.654045:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040128 00000100:00100000:2.0:1788748348.654057:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040128 00000100:00100000:2.0:1788748348.654160:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748348.654172:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377040128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748348.654249:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748348.654334:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377040128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748348.654341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788748348.654428:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd962d80 x1875638377040128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748348.654449:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377040128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748349.550354:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748349.593378:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:32:27 (1788748347) === 00000100:00100000:2.0:1788748349.806277:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748349.806412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748349.806487:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130432 00000100:00100000:2.0:1788748349.806500:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130432 00000100:00100000:2.0:1788748349.806577:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748349.806590:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9685:x1875638358130432:12345-192.168.203.4@tcp:700:mkdir.0 00000100:00100000:2.0:1788748349.806935:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9685:x1875638358130432:12345-192.168.203.4@tcp:700:mkdir.0 Request processed in 345us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748349.806944:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00080000:2.0:1788748349.806970:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748349.808664:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130304 00000100:00100000:0.0:1788748349.808680:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130304 00000100:00100000:0.0:1788748349.808759:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788748349.808769:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358130304:12345-192.168.203.4@tcp:41:mkdir.0 00000004:00000024:0.0:1788748349.808828:0:8052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788748349.808919:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358130304:12345-192.168.203.4@tcp:41:mkdir.0 Request processed in 151us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748349.808926:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748349.813206:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.813293:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130688 00000100:00100000:3.0:1788748349.813957:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130688 00000100:00100000:0.0:1788748349.814245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788748349.814264:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9685:x1875638358130688:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:0.0:1788748349.814445:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748349.814731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7bf49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521568 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.814770:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748349.814782:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748349.815270:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.815285:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.815295:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.815340:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.815348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.815355:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748349.819411:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788748349.819440:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819453:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819463:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819470:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748349.819476:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819502:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819522:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09900) 00010000:00010000:2.0:1788748349.819525:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748349.819530:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.819537:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c068 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748349.819562:0:5845:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007db38d1c reply state 00000000ff405831 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748349.819574:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748349.822470:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9685:x1875638358130688:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 8198us (9263us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788748349.822484:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:0.0:1788748349.825362:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825393:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825401:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825407:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748349.825412:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825420:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825436:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cec3e09000) 00010000:00010000:0.0:1788748349.825440:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748349.825445:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.825452:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c06f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748349.835933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.836860:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358130816 00000100:00100000:3.0:1788748349.836877:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358130816 00000100:00100000:3.0:1788748349.836970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788748349.837109:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9686:x1875638358130816:12345-192.168.203.4@tcp:101:chmod.0 00010000:00010000:3.0:1788748349.837139:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748349.837170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.837418:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.837435:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.837468:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748349.837518:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748349.837523:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748349.837569:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.837598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ed expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.837620:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ed expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.838300:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769b00) 00010000:00010000:3.0:1788748349.838316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748349.838323:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42e00, rc 0) 00000100:00100000:3.0:1788748349.838423:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9686:x1875638358130816:12345-192.168.203.4@tcp:101:chmod.0 Request processed in 1317us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748349.838432:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748349.840627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.840736:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131072 00000100:00100000:3.0:1788748349.840749:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131072 00000100:00100000:3.0:1788748349.840829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788748349.840841:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9686:x1875638358131072:12345-192.168.203.4@tcp:36:chmod.0 00010000:00010000:3.0:1788748349.840911:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748349.840945:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c07d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ed expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.841003:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769b00) 00010000:00010000:3.0:1788748349.841048:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748349.841082:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.841098:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.841109:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748349.841785:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001b7fe870 reply state 000000007e93c8e8 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748349.841799:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788748349.841812:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748349.841972:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:9686:x1875638358131072:12345-192.168.203.4@tcp:36:chmod.0 Request processed in 1131us (1355us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788748349.841990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00010000:00010000:1.0:1788748349.846079:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846098:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846106:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846112:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748349.846117:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846134:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846154:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769500) 00010000:00010000:1.0:1788748349.846158:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788748349.846163:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748349.846169:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c084 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748349.870144:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748349.870480:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131200 00000100:00100000:0.0:1788748349.870494:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131200 00000100:00100000:0.0:1788748349.870666:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748349.870679:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9687:x1875638358131200:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:0.0:1788748349.870773:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748349.870870:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c08b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215f4 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.870991:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.871008:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.871070:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748349.871118:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788748349.871122:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748349.871358:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.871393:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c08b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215f4 expref: 9 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.871415:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215f4 expref: 8 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.871424:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09000) 00010000:00010000:0.0:1788748349.871428:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748349.871432:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5000, rc 0) 00000100:00100000:0.0:1788748349.871790:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:9687:x1875638358131200:12345-192.168.203.4@tcp:101:chown.0 Request processed in 1112us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748349.871799:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748349.874680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.874873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131328 00000100:00100000:3.0:1788748349.874888:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131328 00000100:00100000:3.0:1788748349.875134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788748349.875149:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:9687:x1875638358131328:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:3.0:1788748349.875243:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748349.875278:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265215fb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875406:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875424:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875447:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875467:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875475:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875482:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875836:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875846:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.875854:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748349.875895:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748349.875899:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748349.875927:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876052:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876061:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876068:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876074:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.876079:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876088:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876102:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09000) 00010000:00010000:3.0:1788748349.876105:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.876112:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876425:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876445:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876452:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876458:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876472:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.876476:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876483:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876492:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cec9769b00) 00010000:00010000:3.0:1788748349.876495:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.876498:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876504:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876622:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215fb expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876640:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215fb expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.876647:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748349.876649:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748349.876651:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43c00, rc 0) 00000100:00100000:3.0:1788748349.876817:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:9687:x1875638358131328:12345-192.168.203.4@tcp:101:chown.0 Request processed in 1670us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748349.876825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788748349.882326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.882417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131584 00000100:00100000:3.0:1788748349.882440:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131584 00000100:00100000:3.0:1788748349.882503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1788748349.882514:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:9687:x1875638358131584:12345-192.168.203.4@tcp:36:chown.0 00010000:00010000:3.0:1788748349.882761:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748349.882795:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215fb expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.882815:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748349.882828:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748349.882859:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.882874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.882886:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748349.928287:0:5844:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007c6de156 reply state 00000000529b472b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748349.928319:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788748349.928339:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748349.928482:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:9687:x1875638358131584:12345-192.168.203.4@tcp:36:chown.0 Request processed in 45962us (46171us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788748349.928492:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000001:00080000:3.0:1788748349.928541:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1788748349.928581:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1788748349.928601:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928645:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928655:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928662:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.928668:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928677:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928697:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769c00) 00010000:00010000:3.0:1788748349.928700:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748349.928706:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.928713:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748349.946266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748349.946400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131712 00000100:00100000:0.0:1788748349.946430:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131712 00000100:00100000:3.0:1788748349.946600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1788748349.946616:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceeccf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9688:x1875638358131712:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:3.0:1788748349.946647:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748349.946674:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521602 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748349.948151:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1412us 00010000:00010000:3.0:1788748349.961050:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961099:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961117:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961142:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961148:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961572:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961582:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961591:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748349.961619:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748349.961624:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748349.961668:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961682:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961699:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961707:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961714:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.961719:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961728:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961743:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09000) 00010000:00010000:3.0:1788748349.961746:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.961752:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961758:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961770:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961775:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961782:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961787:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.961797:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961803:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.961811:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cec9769c00) 00010000:00010000:3.0:1788748349.961814:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.961817:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.963979:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.964155:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521602 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.964174:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521602 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.964184:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748349.964187:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788748349.964191:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43600, rc 0) 00000100:00100000:3.0:1788748349.964473:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceeccf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9688:x1875638358131712:12345-192.168.203.4@tcp:101:touch.500 Request processed in 17859us (18218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748349.964485:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788748349.970279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748349.972813:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358131968 00000100:00100000:3.0:1788748349.972836:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358131968 00000100:00100000:3.0:1788748349.972926:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788748349.972939:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9688:x1875638358131968:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:3.0:1788748349.972980:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748349.973005:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521609 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973394:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973415:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973428:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973799:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973823:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.973836:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748349.976130:0:8052:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788748349.978214:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979096:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979111:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979174:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979182:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979189:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979195:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.979200:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979207:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979219:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748349.979238:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.979243:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979249:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c0df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748349.979264:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009775e66e reply state 00000000e9997c5e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748349.979273:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788748349.979324:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c0d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521609 expref: 10 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979352:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521609 expref: 9 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.979359:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec9769b00) 00010000:00010000:3.0:1788748349.979362:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748349.979364:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43800, rc 0) 00000100:00100000:3.0:1788748349.979516:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:9688:x1875638358131968:12345-192.168.203.4@tcp:101:touch.500 Request processed in 6578us (9250us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788748349.979525:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748349.985729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1788748349.986458:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986473:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986482:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986489:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.986495:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986504:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986523:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff99cec9769c00) 00010000:00010000:3.0:1788748349.986527:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.986533:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.986553:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c0e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748349.989595:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132224 00000100:00100000:0.0:1788748349.989994:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132224 00000100:00100000:0.0:1788748349.990263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788748349.990276:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:9688:x1875638358132224:12345-192.168.203.4@tcp:36:touch.500 00010000:00010000:0.0:1788748349.990433:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748349.990470:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c0ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521609 expref: 9 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.990494:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec9769b00) 00010000:00010000:0.0:1788748349.990509:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748349.990602:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.990788:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748349.990801:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748349.991196:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000098989da2 reply state 0000000094a75820 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748349.991209:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748349.991708:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:9688:x1875638358132224:12345-192.168.203.4@tcp:36:touch.500 Request processed in 1430us (5989us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788748349.991717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00010000:00010000:3.0:1788748349.994441:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994467:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994476:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994483:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748349.994489:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994498:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994629:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:3.0:1788748349.994633:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748349.994641:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748349.994648:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c0fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748349.994798:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748349.995110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132352 00000100:00100000:2.0:1788748349.995124:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132352 00000100:00100000:2.0:1788748349.995191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:2.0:1788748349.995203:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:9688:x1875638358132352:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788748349.995236:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748349.995264:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521610 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.995365:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521610 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.995409:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521610 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748349.995440:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:2.0:1788748349.995444:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748349.995448:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2600, rc 0) 00000100:00100000:2.0:1788748349.996011:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:9688:x1875638358132352:12345-192.168.203.4@tcp:101:touch.500 Request processed in 807us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748349.996172:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:2.0:1788748350.000529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748350.000878:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132480 00000100:00100000:1.0:1788748350.000892:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132480 00000100:00100000:1.0:1788748350.001052:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788748350.001063:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875638358132480:12345-192.168.203.4@tcp:8:touch.500 00010000:00080000:1.0:1788748350.001106:0:6696:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1788748350.001150:0:6696:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7c109 00002000:00100000:1.0:1788748350.001166:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b6e58be-3dc9-4518-a85f-e723d86d70a3/ffff99cefd853800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748350.001196:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748350.002325:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748350.002438:0:6696:0:(import.c:65:import_set_state_nolock()) ffff99cefd850800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748350.002542:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358132480:12345-192.168.203.4@tcp:8:touch.500 Request processed in 1478us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748350.002551:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748350.007759:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748350.007835:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132608 00000100:00100000:1.0:1788748350.007849:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132608 00000100:00080000:2.0:1788748350.008232:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748350.008317:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788748350.008331:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:0:x1875638358132608:12345-192.168.203.4@tcp:2:touch.500 00000100:00100000:1.0:1788748350.044535:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:0:x1875638358132608:12345-192.168.203.4@tcp:2:touch.500 Request processed in 36188us (36825us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788748350.044553:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000001:00080000:0.0:1788748350.044653:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788748350.044683:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000100:00100000:0.0:1788748350.048874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748350.049003:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132864 00000100:00100000:1.0:1788748350.049055:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132864 00000100:00100000:1.0:1788748350.049136:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788748350.049149:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:9688:x1875638358132864:12345-192.168.203.4@tcp:35:touch.500 00000100:00100000:1.0:1788748350.049652:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:9688:x1875638358132864:12345-192.168.203.4@tcp:35:touch.500 Request processed in 504us (792us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788748350.049661:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788748350.065603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748350.065778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358132992 00000100:00100000:3.0:1788748350.065802:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358132992 00000100:00100000:3.0:1788748350.065881:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788748350.065894:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:9689:x1875638358132992:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1788748350.065957:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748350.065983:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521617 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066129:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066148:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066164:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748350.066217:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748350.066221:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748350.066284:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066328:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521617 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066353:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521617 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.066363:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748350.066366:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748350.066371:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748350.066457:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:9689:x1875638358132992:12345-192.168.203.4@tcp:101:rm.0 Request processed in 565us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748350.066465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788748350.070516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748350.070713:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358133248 00000100:00100000:3.0:1788748350.070724:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358133248 00000100:00100000:3.0:1788748350.070941:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788748350.070953:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:9689:x1875638358133248:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1788748350.070981:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748350.071008:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c11e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652161e expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748350.071187:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788748350.071420:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c11e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652161e expref: 14 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.071436:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09000) 00010000:00010000:3.0:1788748350.071439:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748350.071445:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c11e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652161e expref: 14 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.071461:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42400, rc 0) 00000100:00100000:3.0:1788748350.071554:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:9689:x1875638358133248:12345-192.168.203.4@tcp:101:rm.0 Request processed in 603us (1051us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788748350.071561:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788748350.080142:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748350.080368:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358133376 00000100:00100000:1.0:1788748350.080382:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358133376 00000100:00100000:1.0:1788748350.080454:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748350.080467:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:9689:x1875638358133376:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:1.0:1788748350.091791:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:9689:x1875638358133376:12345-192.168.203.4@tcp:37:rm.0 Request processed in 11310us (11648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748350.091807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788748350.096139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748350.096366:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358133632 00000100:00100000:3.0:1788748350.096381:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358133632 00000100:00100000:3.0:1788748350.096465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748350.096478:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:9689:x1875638358133632:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1788748350.099200:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:9689:x1875638358133632:12345-192.168.203.4@tcp:35:rm.0 Request processed in 2709us (3060us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788748350.099241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1788748350.102276:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748350.102394:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358133888 00000100:00100000:3.0:1788748350.102409:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358133888 00000100:00100000:3.0:1788748350.102483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1788748350.102496:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:9689:x1875638358133888:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1788748350.102532:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748350.102562:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c12c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521625 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.102710:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c133 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.102727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.102741:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748350.102755:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788748350.103661:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c12c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521625 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.103695:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521625 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.103705:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:2.0:1788748350.103709:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748350.103713:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43c00, rc 0) 00000100:00100000:2.0:1788748350.103805:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358133888:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1311us (1541us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788748350.103836:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788748350.109700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748350.109795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358134016 00000100:00100000:2.0:1788748350.109809:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358134016 00000100:00100000:2.0:1788748350.109891:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788748350.109904:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134016:12345-192.168.203.4@tcp:41:rm.0 00000004:00000024:2.0:1788748350.109987:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788748350.110461:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134016:12345-192.168.203.4@tcp:41:rm.0 Request processed in 557us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748350.110471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788748350.120408:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748350.120528:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358134144 00000100:00100000:0.0:1788748350.120544:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358134144 00000100:00100000:0.0:1788748350.120617:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788748350.120630:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134144:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1788748350.120658:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748350.120686:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652162c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120777:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120796:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120810:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120827:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120834:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120840:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.120995:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.121005:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748350.121226:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748350.121353:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788748350.121359:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748350.121387:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121403:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121414:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121421:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121429:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121435:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748350.121440:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121458:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121475:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:2.0:1788748350.121478:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748350.121484:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121491:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121509:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121515:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121521:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748350.121529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121536:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121543:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff99cec3e09300) 00010000:00010000:2.0:1788748350.121546:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748350.121549:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121565:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c14f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121607:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652162c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121623:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652162c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.121631:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:2.0:1788748350.121633:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748350.121636:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5800, rc 0) 00000100:00100000:2.0:1788748350.121767:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:9689:x1875638358134144:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1139us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748350.121775:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788748350.124847:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748350.124944:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358134400 00000100:00100000:3.0:1788748350.124958:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358134400 00000100:00100000:3.0:1788748350.125100:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1788748350.125112:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:9689:x1875638358134400:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1788748350.125296:0:8052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788748350.125343:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652162c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125370:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521610 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125391:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:3.0:1788748350.125413:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521617 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125423:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748350.125427:0:8052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748350.125452:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125468:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125479:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125495:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125503:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125509:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125645:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125654:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.125672:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748350.127276:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788748350.127294:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267170279038ns, next at 268170274831ns, rc = 0 00010000:00010000:3.0:1788748350.127394:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127412:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127425:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127435:0:8052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127443:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127449:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127526:0:8052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748350.127544:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748350.127559:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127566:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127571:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127589:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748350.127594:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127603:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127613:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127617:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec9769600) 00010000:00010000:3.0:1788748350.127620:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788748350.127623:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748350.127625:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127626:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127631:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c16b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127633:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127642:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cec9769600) 00010000:00010000:2.0:1788748350.127644:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748350.127655:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127662:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127667:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127671:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748350.127674:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127680:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.127765:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748350.127768:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748350.127773:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127785:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127792:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cf02056a00/0x5b377f42a7a7c172 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.127812:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748350.127814:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748350.127816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748350.127849:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c15d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748350.127863:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000af88f817 reply state 00000000e95e8466 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748350.127872:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748350.128381:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134400:12345-192.168.203.4@tcp:36:rm.0 Request processed in 3264us (3538us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788748350.128392:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00010000:00010000:3.0:1788748350.130470:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130491:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130500:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130508:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748350.130513:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130522:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130564:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff99cec9769c00) 00010000:00010000:3.0:1788748350.130567:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748350.130695:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.130946:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c164 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748350.132698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748350.133216:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358134656 00000100:00100000:1.0:1788748350.133231:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358134656 00000100:00100000:1.0:1788748350.133297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748350.133319:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:9689:x1875638358134656:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:1.0:1788748350.133873:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134656:12345-192.168.203.4@tcp:35:rm.0 Request processed in 565us (1186us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788748350.133883:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748350.136081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748350.136377:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358134912 00000100:00100000:2.0:1788748350.136389:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358134912 00000100:00100000:2.0:1788748350.136453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1788748350.136464:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:9689:x1875638358134912:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:2.0:1788748350.136540:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788748350.136573:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521625 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.136932:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7c0d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521602 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.136945:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec9769100) 00010000:00010000:2.0:1788748350.136964:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c092 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215f4 expref: 14 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.136975:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec3e09000) 00010000:00010000:2.0:1788748350.136982:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748350.137039:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137054:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137084:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137100:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137107:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137113:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137525:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137534:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.137542:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748350.139513:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788748350.139546:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139558:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139566:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139573:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748350.139640:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139649:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139666:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cec6646500) 00010000:00010000:2.0:1788748350.139670:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788748350.139674:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7c187 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139848:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139856:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139863:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139868:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748350.139871:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139877:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139885:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646c00) 00010000:00010000:2.0:1788748350.139887:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748350.139897:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748350.139903:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7c179 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748350.139917:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b91dc740 reply state 000000005b3628bd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748350.139927:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748350.140283:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:9689:x1875638358134912:12345-192.168.203.4@tcp:36:rm.0 Request processed in 3813us (4207us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788748350.140294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00010000:00010000:3.0:1788748350.145989:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146065:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146076:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146083:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748350.146089:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146098:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146118:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cec6646700) 00010000:00010000:3.0:1788748350.146122:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748350.146129:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748350.146135:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c180 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748350.574601:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748351.523521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748351.523603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748351.523638:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748351.523668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748351.523703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135168 00000100:00100000:0.0:1788748351.523714:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135168 00000100:00100000:0.0:1788748351.523789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135424 00000100:00100000:0.0:1788748351.523792:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135424 00000100:00100000:0.0:1788748351.523816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1788748351.523826:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2347:x1875638358135168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748351.523906:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2347:x1875638358135168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748351.523913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1788748351.523938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:0.0:1788748351.523946:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358135424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748351.523993:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358135424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748351.524001:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00080000:0.0:1788748351.524054:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748351.524575:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135296 00000100:00100000:2.0:1788748351.524580:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135296 00000100:00100000:2.0:1788748351.524620:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1788748351.524629:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358135296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748351.524670:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358135296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748351.524677:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788748351.526500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135040 00000100:00100000:3.0:1788748351.526511:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135040 00000100:00100000:3.0:1788748351.526792:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:3.0:1788748351.526802:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358135040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748351.526875:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358135040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748351.526882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00010000:00010000:1.0:1788748351.597239:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748352.622393:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748352.749359:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377040640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748352.749403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377040384:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.749430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748352.749446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.749748:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377040256:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.749782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.749826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040256 00000100:00100000:2.0:1788748352.749834:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040256 00000100:00100000:2.0:1788748352.749878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788748352.749887:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377040256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.749936:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377040256:12345-0@lo:400:kworker.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.749956:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788748352.749987:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040640 00000100:00100000:2.0:1788748352.749991:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040640 00000100:00100000:2.0:1788748352.750048:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748352.750056:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377040640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.750089:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377040640:12345-0@lo:400:kworker.0 Request processed in 34us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.750095:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748352.750112:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377040512:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.750135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.750171:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040384 00000100:00100000:2.0:1788748352.750174:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040384 00000100:00100000:2.0:1788748352.750194:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040512 00000100:00100000:2.0:1788748352.750196:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040512 00000100:00100000:2.0:1788748352.750213:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748352.750218:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377040384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.750249:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377040384:12345-0@lo:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.750255:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748352.750265:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788748352.750270:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.750310:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377040512:12345-0@lo:400:kworker.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.750315:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788748352.750330:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748352.750333:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788748352.750901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7316a00 x1875638377040640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748352.750916:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377040640:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.753136:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377040256:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.753152:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377040768:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.753203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748352.753328:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377040512:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.753424:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040768 00000100:00100000:1.0:1788748352.753444:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040768 00000100:00100000:1.0:1788748352.753510:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788748352.753519:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377040768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748352.753569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377040384:0@lo:400:kworker.0 00000100:00100000:0.0:1788748352.753578:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377040896:0@lo:400:kworker.0 00000100:00100000:0.0:1788748352.753608:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748352.753634:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377040896 00000100:00100000:0.0:1788748352.753638:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377040896 00000100:00100000:0.0:1788748352.753666:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748352.753673:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377040896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748352.753715:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377040896:12345-0@lo:400:kworker.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748352.753736:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788748352.753791:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7314e00 x1875638377040896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748352.753813:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377040896:0@lo:400:kworker.0 00000100:00080000:3.0:1788748352.753863:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748352.753869:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748352.753939:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377040768:12345-0@lo:400:kworker.0 Request processed in 420us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.753947:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788748352.754038:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377040768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748353.264825:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377041024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748353.264928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748353.265053:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041024 00000100:00100000:0.0:1788748353.265069:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041024 00000100:00100000:0.0:1788748353.265131:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748353.265142:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377041024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748353.265178:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748353.265280:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377041024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748353.265299:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788748353.265800:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee52e3480 x1875638377041024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748353.265819:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377041024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748353.645467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748353.770898:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1788748353.773396:0:6921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 270816378645ns, next at 271816376187ns, rc = 0 00000100:00100000:2.0:1788748353.773830:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748353.773850:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377041152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748353.773915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748353.774148:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041152 00000100:00100000:3.0:1788748353.774155:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041152 00000100:00100000:3.0:1788748353.774288:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748353.774298:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377041152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748353.774335:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748353.775369:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377041152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1067us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748353.775394:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788748353.779521:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cf0194e680 x1875638377041152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748353.779548:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377041152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748354.674859:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748354.713236:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebbd1b610 20000000:00000080:1.0:1788748354.713253:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cefbb09c00 uarg=0000000000000000 20000000:01000000:1.0:1788748354.713299:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788748354.713305:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788748354.713310:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788748354.714320:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788748354.714498:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788748354.720669:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788748354.720930:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788748354.720992:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788748354.721010:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788748354.721168:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721189:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721196:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721217:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721224:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721230:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721236:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721281:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721297:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 18 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.721310:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041280:0@lo:104: 00000100:00100000:1.0:1788748354.721442:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748354.721584:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.721605:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 18 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.721614:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041408:0@lo:104: 00000100:00100000:1.0:1788748354.721637:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748354.722041:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.722057:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 18 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.722066:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041536:0@lo:104: 00000100:00100000:1.0:1788748354.722091:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748354.722209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041280 00000100:00100000:2.0:1788748354.722216:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041280 00000100:00100000:2.0:1788748354.722258:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041408 00000100:00100000:2.0:1788748354.722261:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041408 00000100:00100000:2.0:1788748354.722285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748354.722293:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:11667:x1875638377041280:12345-0@lo:104: 00010000:00010000:2.0:1788748354.722305:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722358:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748354.722364:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+4:11667:x1875638377041280:12345-0@lo:104: Request processed in 72us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.722370:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748354.722385:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748354.722391:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11667:x1875638377041408:12345-0@lo:104: 00010000:00010000:2.0:1788748354.722397:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722423:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788748354.722427:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11667:x1875638377041408:12345-0@lo:104: Request processed in 37us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.722441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788748354.722461:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748354.722466:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722474:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748354.722478:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722486:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748354.722493:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748354.722498:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748354.722527:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722534:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748354.722553:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722560:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057a00/0x5b377f42a7a7c05a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c061 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722573:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748354.722576:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722592:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748354.722595:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722602:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748354.722608:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748354.722613:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748354.722624:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722630:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748354.722644:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722650:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b43e00/0x5b377f42a7a7c04c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c053 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.722658:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748354.722660:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748354.722661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748354.722666:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748354.722675:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377041664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748354.722712:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748354.722937:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377041792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748354.722968:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748354.723003:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041664 00000100:00100000:2.0:1788748354.723007:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041664 00010000:00010000:2.0:1788748354.723038:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 19 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748354.723056:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041792 00000100:00100000:2.0:1788748354.723059:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041792 00010000:00010000:2.0:1788748354.723068:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 20 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748354.723080:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748354.723086:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3309:x1875638377041664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748354.723095:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748354.723099:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 20 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.723109:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 20 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.723122:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748354.723144:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3309:x1875638377041664:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.723150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748354.723161:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748354.723167:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377041792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748354.723174:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748354.723177:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 19 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.723194:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 19 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.723203:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748354.723225:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377041792:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.723230:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748354.723261:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377041792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748354.723292:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377041664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748354.723559:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.723571:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 12 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.723581:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041920:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748354.723634:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.723642:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.723651:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377042048:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748354.723666:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788748354.723678:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4000/0x5b377f42a7a7c061 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7c05a expref: 18 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.723696:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041280:0@lo:104: 00010000:00010000:1.0:1788748354.723704:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7c053 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7c04c expref: 17 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.723712:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041408:0@lo:104: 00000100:00100000:2.0:1788748354.724056:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788748354.724068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377041536 00000100:00100000:2.0:1788748354.724072:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377041536 00000100:00100000:2.0:1788748354.724100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748354.724107:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb7e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11667:x1875638377041536:12345-0@lo:104: 00010000:00010000:2.0:1788748354.724117:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724164:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748354.724169:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb7e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+3:11667:x1875638377041536:12345-0@lo:104: Request processed in 63us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.724174:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788748354.724205:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748354.724210:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724217:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748354.724226:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724234:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748354.724241:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748354.724246:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748354.724266:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724285:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748354.724300:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724306:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7c03e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7c045 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.724321:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748354.724323:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748354.724324:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748354.724332:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377042176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748354.724436:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041536:0@lo:104: 00000100:00100000:2.0:1788748354.724489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748354.724837:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042176 00000100:00100000:0.0:1788748354.724842:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042176 00010000:00010000:0.0:1788748354.724861:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748354.724912:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748354.724918:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5228050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3307:x1875638377042176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748354.724928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748354.724932:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748354.724941:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748354.724952:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7c045 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7c03e expref: 17 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748354.724962:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748354.724996:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5228050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3307:x1875638377042176:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748354.725002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748354.725097:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377042176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748354.725965:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377041920:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748354.725972:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875638377042048:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748354.725992:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748354.733118:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748354.733198:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748354.733812:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135552 00000100:00100000:1.0:1788748354.733822:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135552 00010000:00010000:1.0:1788748354.733861:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 13 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748354.734039:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135680 00000100:00100000:1.0:1788748354.734043:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135680 00010000:00010000:1.0:1788748354.734070:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 14 pid: 5838 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748354.735684:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788748354.735781:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+14:2348:x1875638358135552:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748354.735806:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748354.735833:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 14 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.735849:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 14 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.735873:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d600/0x5b377f42a7a7c037 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215e6 expref: 14 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.735907:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748354.736210:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358135552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 443us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.736219:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788748354.736254:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788748354.736262:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+12:2348:x1875638358135680:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748354.736281:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748354.736287:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736297:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736307:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7c030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215df expref: 12 pid: 5838 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736318:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736326:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736437:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736451:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736458:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736465:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736471:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748354.736475:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736490:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736603:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748354.736615:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748354.736647:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62c24351-d204-4cbb-bccb-959b10d053e2+11:2348:x1875638358135680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 386us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748354.736662:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00010000:00010000:1.0:1788748354.737100:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.737109:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748354.737121:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9a00/0x5b377f42a7a7c18e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748355.367547:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:0.0:1788748355.367584:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1788748355.367675:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788748355.367685:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788748355.367704:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788748355.368351:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377042304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788748355.368420:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748355.368521:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042304 00000100:00100000:0.0:1788748355.368528:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042304 00000100:00100000:0.0:1788748355.368587:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748355.368607:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377042304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788748355.368632:0:8053:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788748355.368665:0:8053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e223d, atime: 0x6a9e223d, ctime: 0x6a9e223d, blocks: 0x1 00010000:00010000:0.0:1788748355.368674:0:8053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748355.368689:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1788748355.368694:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748355.368701:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748355.368718:0:8053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748355.368728:0:8053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748355.368736:0:8053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748355.368781:0:8053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788748355.368972:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788748355.369424:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748355.369438:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748355.369447:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748355.369451:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748355.369459:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748355.369478:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748355.369689:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df2e96e5/0x5b377f42a7a7c195 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748355.369711:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748355.369713:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748355.369715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748355.370216:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377042304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1617us (1791us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788748355.370307:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788748355.370457:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cef7315f80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788748355.370464:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377042304:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788748355.694133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788748356.461235:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748356.461243:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecebd000 from 7 10000000:01000000:2.0:1788748356.461249:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748356.461311:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.461323:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.461348:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748356.461374:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748356.461439:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748356.461519:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefff0a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.462794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042432 00000100:00100000:3.0:1788748356.462808:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042432 00000100:00100000:3.0:1788748356.462872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788748356.462891:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:5841:x1875638377042432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748356.462906:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748356.462924:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02056a00/0x5b377f42a7a7c1a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c19c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.462957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02056a00/0x5b377f42a7a7c1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c19c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.462967:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02056a00/0x5b377f42a7a7c1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c19c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.462976:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02056a00, rc 0) 00000100:00100000:3.0:1788748356.463094:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377042432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.463101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788748356.463312:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748356.463331:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748356.463341:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748356.463409:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748356.463443:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748356.463485:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb615f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748356.463597:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042560 00000100:00100000:1.0:1788748356.463603:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042560 00000100:00100000:1.0:1788748356.463634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788748356.463644:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377042560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.464177:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377042560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 533us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748356.464185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788748356.464392:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748356.464429:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748356.464471:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748356.464504:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb615f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748356.465443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042688 00000100:00100000:2.0:1788748356.465452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042688 00000100:00100000:2.0:1788748356.465504:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788748356.465514:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377042688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748356.465720:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377042688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.465727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788748356.465942:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377042688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.467177:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11681:1875638377042816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.467236:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748356.467283:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748356.467423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042816 00000100:00100000:2.0:1788748356.467429:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042816 00000100:00100000:2.0:1788748356.467467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788748356.467476:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:11681:x1875638377042816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748356.467676:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:11681:x1875638377042816:12345-0@lo:502:llog_process_th.0 Request processed in 201us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.467683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788748356.468064:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11681:1875638377042816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748356.468093:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748356.468102:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748356.468104:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788748356.468120:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ceecebd000 00000020:00000080:0.0:1788748356.468135:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788748356.468410:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11681:1875638377042944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748356.468450:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748356.468477:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377042944 00000100:00100000:0.0:1788748356.468481:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377042944 00000100:00100000:0.0:1788748356.468507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788748356.468515:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:11681:x1875638377042944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748356.469381:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb615f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748356.469404:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5226a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11681:1875638377042944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748356.469435:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748356.469448:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748356.469450:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788748356.469454:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788748356.469592:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788748356.469609:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748356.469619:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748356.469630:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748356.469640:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748356.469642:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ceecff9800 from 7 10000000:01000000:1.0:1788748356.469645:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:0.0:1788748356.470038:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:11681:x1875638377042944:12345-0@lo:502:llog_process_th.0 Request processed in 1522us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.470047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00010000:1.0:1788748356.471645:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748356.473191:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748356.473207:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748356.473238:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.473317:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748356.473352:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.473816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043072 00000100:00100000:3.0:1788748356.473824:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043072 00000100:00100000:3.0:1788748356.473902:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788748356.473911:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:5841:x1875638377043072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748356.473925:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748356.473940:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cf02057a00/0x5b377f42a7a7c1b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c1aa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.473976:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cf02057a00/0x5b377f42a7a7c1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c1aa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.473985:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cf02057a00/0x5b377f42a7a7c1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c1aa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.473995:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cf02057a00, rc 0) 00000100:00100000:3.0:1788748356.474062:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.474069:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788748356.475093:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748356.475117:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748356.476722:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748356.476822:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.476893:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748356.476930:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.478286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043200 00000100:00100000:3.0:1788748356.478299:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043200 00000100:00100000:3.0:1788748356.478355:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788748356.478364:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.478638:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.478646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788748356.478836:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.478890:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.478930:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748356.478966:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.483158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043328 00000100:00100000:3.0:1788748356.483172:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043328 00000100:00100000:3.0:1788748356.483222:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788748356.483230:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.483457:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.483470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788748356.483695:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.486380:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11684:1875638377043456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.486449:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748356.486489:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748356.487776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043456 00000100:00100000:2.0:1788748356.487788:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043456 00000100:00100000:2.0:1788748356.487837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788748356.487846:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:11684:x1875638377043456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.488249:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11684:1875638377043456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748356.488291:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748356.488299:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748356.488301:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788748356.488307:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ceecff9800 00000020:00000080:3.0:1788748356.488309:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788748356.488387:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11684:1875638377043584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.488425:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748356.488451:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.488800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043584 00000100:00100000:3.0:1788748356.488805:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043584 00000100:00100000:3.0:1788748356.488831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788748356.488839:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11684:x1875638377043584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.489011:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11684:x1875638377043584:12345-0@lo:502:llog_process_th.0 Request processed in 171us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.489354:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11684:x1875638377043456:12345-0@lo:502:llog_process_th.0 Request processed in 1507us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.489370:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788748356.489436:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11684:1875638377043584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748356.489458:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748356.489463:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748356.489465:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788748356.489469:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788748356.489534:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788748356.489551:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748356.489561:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.489573:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748356.489583:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748356.489585:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec8720800 from 7 10000000:01000000:2.0:1788748356.489587:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748356.489612:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.489620:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.489629:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748356.489644:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.489718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788748356.490074:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748356.491441:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefff0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.492255:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043712 00000100:00100000:3.0:1788748356.492276:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043712 00000100:00100000:3.0:1788748356.492330:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788748356.492339:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:5841:x1875638377043712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748356.492366:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748356.492384:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43e00/0x5b377f42a7a7c1bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7c1b8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.492411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43e00/0x5b377f42a7a7c1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7c1b8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.492423:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43e00/0x5b377f42a7a7c1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7c1b8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.492431:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43e00, rc 0) 00000100:00100000:3.0:1788748356.492506:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377043712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.492513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788748356.495418:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748356.495446:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748356.495458:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748356.495533:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.495590:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748356.495629:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.495885:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043840 00000100:00100000:3.0:1788748356.495892:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043840 00000100:00100000:3.0:1788748356.495943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788748356.495953:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377043840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.496410:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377043840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 457us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.496419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788748356.497302:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.497358:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.497417:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748356.497462:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748356.497607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377043968 00000100:00100000:3.0:1788748356.497614:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377043968 00000100:00100000:3.0:1788748356.497651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788748356.497658:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377043968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.497827:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:5841:x1875638377043968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.497843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788748356.497884:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e30aac72-4ae1-4e90-ba43-18115a48a5f4:5841:1875638377043968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748356.500573:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11685:1875638377044096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.500650:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748356.500725:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726840 going to sleep for 11 seconds 00000040:00080000:0.0:1788748356.504274:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748356.509479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044096 00000100:00100000:2.0:1788748356.509494:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044096 00000100:00100000:3.0:1788748356.509613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788748356.509623:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11685:x1875638377044096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748356.509877:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11685:x1875638377044096:12345-0@lo:502:llog_process_th.0 Request processed in 255us (9226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.509885:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788748356.509999:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf0194e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11685:1875638377044096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748356.510064:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748356.510073:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748356.510076:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788748356.510082:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cec8720800 00000020:00000080:2.0:1788748356.510085:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788748356.512370:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11685:1875638377044224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748356.512445:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748356.512494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044224 00000100:00100000:2.0:1788748356.512501:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044224 00000100:00100000:2.0:1788748356.512542:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788748356.512549:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11685:x1875638377044224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748356.512738:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:11685:x1875638377044224:12345-0@lo:502:llog_process_th.0 Request processed in 188us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.512746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788748356.512792:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefff0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748356.512811:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e30aac72-4ae1-4e90-ba43-18115a48a5f4:11685:1875638377044224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748356.512836:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748356.512843:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748356.512845:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788748356.512849:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788748356.515760:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788748356.515793:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748356.515804:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748356.515838:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748356.645197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748356.645246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748356.645293:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748356.645320:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748356.645347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135936 00000100:00100000:2.0:1788748356.645356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135936 00000100:00100000:2.0:1788748356.645413:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136192 00000100:00100000:2.0:1788748356.645416:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136192 00000100:00100000:2.0:1788748356.645441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1788748356.645451:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358135936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748356.645522:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358135936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.645530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1788748356.645546:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788748356.645553:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358136192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748356.645579:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358136192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.645585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00080000:2.0:1788748356.645603:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748356.646292:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358135808 00000100:00100000:1.0:1788748356.646300:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358135808 00000100:00100000:1.0:1788748356.646339:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:1.0:1788748356.646347:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+11:2350:x1875638358135808:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748356.646384:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+11:2350:x1875638358135808:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748356.646391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:3.0:1788748356.646907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136064 00000100:00100000:3.0:1788748356.646912:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136064 00000100:00100000:3.0:1788748356.647539:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788748356.647552:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358136064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748356.647615:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358136064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.647621:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00080000:2.0:1788748356.656663:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748356.706107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748356.706215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136320 00000100:00100000:3.0:1788748356.706229:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136320 00000100:00100000:3.0:1788748356.706307:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 262 00000100:00100000:3.0:1788748356.706319:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+11:5591:x1875638358136320:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748356.706343:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748356.706368:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7c1c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.706441:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7c1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521633 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.706454:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7c1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521633 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748356.706464:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43600, rc 0) 00000100:00100000:3.0:1788748356.706538:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136320:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 221us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.706546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 262 00000100:00100000:3.0:1788748356.716559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.718590:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136448 00000100:00100000:0.0:1788748356.718610:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136448 00000100:00100000:0.0:1788748356.718690:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 263 00000100:00100000:0.0:1788748356.718702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136448:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00010000:00010000:2.0:1788748356.719699:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748356.724458:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136448:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 5738us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.724478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 263 00000100:00100000:3.0:1788748356.733112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.738854:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136576 00000100:00100000:0.0:1788748356.738876:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136576 00000100:00100000:0.0:1788748356.738965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:0.0:1788748356.738977:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136576:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748356.739319:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136576:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 343us (6220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.739328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:2.0:1788748356.742618:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.743082:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136704 00000100:00100000:0.0:1788748356.743096:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136704 00000100:00100000:0.0:1788748356.743160:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:0.0:1788748356.743172:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:9959:x1875638358136704:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748356.743517:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:9959:x1875638358136704:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 346us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.743525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:2.0:1788748356.753480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.756316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136832 00000100:00100000:0.0:1788748356.756340:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136832 00000100:00100000:0.0:1788748356.756474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:1.0:1788748356.756650:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:9959:x1875638358136832:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748356.757010:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+12:9959:x1875638358136832:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 524us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748356.757039:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:1.0:1788748356.766401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.766513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358136960 00000100:00100000:0.0:1788748356.766528:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358136960 00000100:00100000:0.0:1788748356.766598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:0.0:1788748356.766611:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+12:5591:x1875638358136960:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748356.766633:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748356.766657:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7c1cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee622652163a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748356.766692:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7c1cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652163a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748356.766721:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7c1cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652163a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748356.766732:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4c00, rc 0) 00000100:00100000:0.0:1788748356.766811:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358136960:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 202us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.766819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:3.0:1788748356.768386:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748356.768496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137088 00000100:00100000:1.0:1788748356.768518:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137088 00000100:00100000:1.0:1788748356.768579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00100000:1.0:1788748356.768591:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358137088:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748356.768984:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358137088:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 392us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748356.768993:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00100000:3.0:1788748356.773370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748356.779428:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137216 00000100:00100000:2.0:1788748356.779452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137216 00000100:00100000:2.0:1788748356.779549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:2.0:1788748356.779561:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358137216:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748356.779915:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:5591:x1875638358137216:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 352us (6557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.779924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:2.0:1788748356.785214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748356.789150:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137344 00000100:00100000:0.0:1788748356.789172:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137344 00000100:00100000:0.0:1788748356.789280:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:0.0:1788748356.789294:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:9962:x1875638358137344:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748356.789680:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:9962:x1875638358137344:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 386us (4477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748356.789690:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:0.0:1788748356.800624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748356.804986:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137472 00000100:00100000:3.0:1788748356.805008:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137472 00000100:00100000:3.0:1788748356.805110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:3.0:1788748356.805122:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:9962:x1875638358137472:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748356.805552:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:9962:x1875638358137472:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 431us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.805561:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 271 00000040:00080000:3.0:1788748357.551883:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748357.741446:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748357.872561:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377044480:0@lo:400:kworker.0 00000100:00100000:2.0:1788748357.872647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748357.872727:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377044992:0@lo:400:kworker.0 00000100:00100000:2.0:1788748357.872782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748357.872831:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748357.872838:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377044608:0@lo:400:kworker.0 00000100:00100000:2.0:1788748357.872863:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.872980:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.873031:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.873057:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788748357.873063:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.873093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748357.873491:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044992 00000100:00100000:0.0:1788748357.873502:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044992 00000100:00100000:0.0:1788748357.873563:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044736 00000100:00100000:0.0:1788748357.873566:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044736 00000100:00100000:0.0:1788748357.873587:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748357.873597:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377044992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.873665:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377044992:12345-0@lo:400:kworker.0 Request processed in 69us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748357.873672:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748357.873690:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748357.873697:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.873727:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377044736:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748357.873733:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788748357.873756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748357.873761:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748357.875870:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377044864:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.875978:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.876073:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.876129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044480 00000100:00100000:1.0:1788748357.876136:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044480 00000100:00100000:1.0:1788748357.876193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044608 00000100:00100000:1.0:1788748357.876197:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044608 00000100:00100000:1.0:1788748357.876230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044864 00000100:00100000:1.0:1788748357.876233:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044864 00000100:00100000:1.0:1788748357.876440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788748357.876449:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377044480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.876511:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377044480:12345-0@lo:400:kworker.0 Request processed in 64us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.876519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788748357.876538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788748357.876544:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.876572:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377044608:12345-0@lo:400:kworker.0 Request processed in 29us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.876578:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788748357.876588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748357.876595:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.876624:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377044864:12345-0@lo:400:kworker.0 Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.876631:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748357.876672:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377044864:0@lo:400:kworker.0 00000100:00080000:1.0:1788748357.876827:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748357.877102:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377044608:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.877121:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377044480:0@lo:400:kworker.0 00010000:00080000:1.0:1788748357.877139:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefd962a00 x1875638377044992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.877151:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377044992:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.888486:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377044352 00000100:00100000:0.0:1788748357.888511:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377044352 00000100:00100000:0.0:1788748357.888593:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788748357.888606:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377044352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.888761:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377044352:12345-0@lo:400:kworker.0 Request processed in 157us (15666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748357.888770:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788748357.888947:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748358.386789:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748358.386910:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748358.387378:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045120 00000100:00100000:2.0:1788748358.387390:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045120 00000100:00100000:2.0:1788748358.387459:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788748358.387470:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377045120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748358.387522:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748358.387599:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377045120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748358.387692:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788748358.387846:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceed61f800 x1875638377045120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748358.387873:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377045120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748358.766846:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748358.893703:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748358.893738:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377045248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748358.893848:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748358.894053:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045248 00000100:00100000:1.0:1788748358.894065:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045248 00000100:00100000:1.0:1788748358.894132:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748358.894143:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377045248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748358.894189:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748358.894261:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377045248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748358.894269:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748358.894407:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377045248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748359.790070:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788748360.491109:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788748360.813465:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748361.764147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748361.764200:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748361.764259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748361.764275:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137728 00000100:00100000:1.0:1788748361.764290:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137728 00000100:00100000:3.0:1788748361.764299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748361.764333:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137856 00000100:00100000:3.0:1788748361.764349:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137856 00000100:00100000:2.0:1788748361.764355:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137984 00000100:00100000:2.0:1788748361.764362:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137984 00000100:00100000:1.0:1788748361.764373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1788748361.764384:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358137728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748361.764400:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:2.0:1788748361.764408:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358137984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748361.764412:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:3.0:1788748361.764424:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358137856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748361.764498:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358137728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748361.764506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00080000:1.0:1788748361.764531:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748361.764537:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748361.764693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358137600 00000100:00100000:0.0:1788748361.764698:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358137600 00000100:00100000:0.0:1788748361.764737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:0.0:1788748361.764747:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358137600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748361.769585:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358137984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 5159us (5364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748361.769605:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:3.0:1788748361.772970:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358137856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 8531us (8652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748361.772990:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1788748361.773242:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358137600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 8492us (8977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748361.773253:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 273 00010000:00010000:2.0:1788748361.838196:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748362.862523:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748362.989656:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377045376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748362.989771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748362.990292:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377045760:0@lo:400:kworker.0 00000100:00100000:2.0:1788748362.990340:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748362.990420:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788748362.990450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748362.990471:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748362.990477:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377045504:0@lo:400:kworker.0 00000100:00100000:2.0:1788748362.990496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748362.990533:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045376 00000100:00100000:2.0:1788748362.990543:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045376 00000100:00100000:2.0:1788748362.990603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788748362.990613:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.990763:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045632 00000100:00100000:3.0:1788748362.990769:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045632 00000100:00100000:3.0:1788748362.990813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045504 00000100:00100000:3.0:1788748362.990817:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045504 00000100:00100000:3.0:1788748362.990836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748362.990843:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377045632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.990890:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377045632:12345-0@lo:400:kworker.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748362.990897:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748362.990916:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788748362.990922:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377045504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.990950:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377045504:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748362.990955:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788748362.990975:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748362.991011:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377045504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.991055:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377045632:0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.991148:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045760 00000100:00100000:3.0:1788748362.991152:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045760 00000100:00100000:3.0:1788748362.991189:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788748362.991196:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377045760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748362.991787:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377045760:12345-0@lo:400:kworker.0 Request processed in 588us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748362.991796:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788748362.991882:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748362.992048:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788748362.992054:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cef7315f80, transno 4294967300 00000100:00100000:3.0:1788748362.992069:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377045760:0@lo:400:kworker.0 00000100:00100000:0.0:1788748362.999431:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.000286:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377045376:12345-0@lo:400:kworker.0 Request processed in 9666us (10506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.000304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788748363.000891:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377046016:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.000970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748363.001057:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046016 00000100:00100000:1.0:1788748363.001088:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046016 00000100:00100000:1.0:1788748363.001151:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788748363.001162:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377046016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.001230:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377046016:12345-0@lo:400:kworker.0 Request processed in 58us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.001238:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788748363.001260:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788748363.001292:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7314e00 x1875638377046016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748363.001308:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377046016:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.001992:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377045888:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.002143:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748363.002925:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377045888 00000100:00100000:1.0:1788748363.002936:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377045888 00000100:00100000:1.0:1788748363.003057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788748363.003067:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.003327:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377045888:12345-0@lo:400:kworker.0 Request processed in 260us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.003336:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748363.003427:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377045888:0@lo:400:kworker.0 00000100:00080000:3.0:1788748363.006138:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748363.501342:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377046144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748363.501447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748363.501842:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046144 00000100:00100000:3.0:1788748363.501853:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046144 00000100:00100000:3.0:1788748363.501929:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748363.501941:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377046144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748363.501986:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748363.503289:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377046144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1344us (1834us total) trans 0 rc 0/0 00010000:00080000:1.0:1788748363.503291:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceed61ea00 x1875638377046144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748363.503301:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748363.503318:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377046144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748363.887233:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748364.013585:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377046272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748364.013662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748364.013851:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046272 00000100:00100000:3.0:1788748364.013860:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046272 00000100:00080000:1.0:1788748364.013907:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748364.013959:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748364.013969:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377046272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748364.014048:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748364.014105:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377046272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748364.014293:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377046272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748364.014468:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1788748364.911380:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748365.935060:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748366.889478:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748366.889548:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748366.889569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138112 00000100:00100000:0.0:1788748366.889581:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138112 00000100:00100000:1.0:1788748366.889586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748366.889635:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:1.0:1788748366.889636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748366.889651:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358138112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748366.889701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138240 00000100:00100000:2.0:1788748366.889707:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138240 00000100:00100000:0.0:1788748366.889730:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358138112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748366.889739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:2.0:1788748366.889756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138496 00000100:00100000:2.0:1788748366.889760:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138496 00000100:00080000:0.0:1788748366.889785:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748366.889789:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:2.0:1788748366.889799:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358138240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748366.889823:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:0.0:1788748366.889839:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358138496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748366.889840:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358138240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748366.889852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:0.0:1788748366.889875:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358138496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748366.889882:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:3.0:1788748366.894204:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138368 00000100:00100000:3.0:1788748366.894221:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138368 00000100:00100000:3.0:1788748366.894314:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1788748366.894324:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358138368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748366.894410:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358138368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (4862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748366.894422:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00080000:1.0:1788748366.895290:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788748366.957762:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748367.789764:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748367.981999:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748368.110523:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748368.110546:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377046400:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.110614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.110695:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046400 00000100:00100000:3.0:1788748368.110704:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046400 00000100:00100000:3.0:1788748368.110749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788748368.110757:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.110804:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377046400:12345-0@lo:400:kworker.0 Request processed in 48us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.110810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788748368.110856:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.111058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377046528:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.111091:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.111230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046528 00000100:00100000:3.0:1788748368.111234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046528 00000100:00100000:3.0:1788748368.111267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788748368.111274:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377046528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.111308:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377046528:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.111331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788748368.119766:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377046656:0@lo:400:kworker.0 00000100:00100000:1.0:1788748368.119797:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.119841:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.119888:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748368.119894:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377047040:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.119919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.119946:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046656 00000100:00100000:0.0:1788748368.119953:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046656 00000100:00100000:0.0:1788748368.120027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788748368.120035:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.120104:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377046656:12345-0@lo:400:kworker.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748368.120127:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788748368.120199:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377046656:0@lo:400:kworker.0 00000100:00100000:1.0:1788748368.120401:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047040 00000100:00100000:1.0:1788748368.120407:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047040 00000100:00100000:1.0:1788748368.120452:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748368.120461:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377047040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.120476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377046784:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.120517:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748368.120531:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377047040:12345-0@lo:400:kworker.0 Request processed in 71us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748368.120539:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748368.120554:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046784 00000100:00100000:1.0:1788748368.120557:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046784 00000100:00080000:3.0:1788748368.120574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748368.120580:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748368.120582:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788748368.120584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748368.120592:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377046784:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788748368.120610:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef7316680 x1875638377047040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.120623:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377047040:0@lo:400:kworker.0 00000100:00100000:1.0:1788748368.120635:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377046784:12345-0@lo:400:kworker.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.120658:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.120945:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.121039:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377046912 00000100:00100000:3.0:1788748368.121044:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377046912 00000100:00100000:3.0:1788748368.121100:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788748368.121106:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.121144:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377046912:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.121150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788748368.121311:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748368.121336:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377046912:0@lo:400:kworker.0 00000100:00100000:1.0:1788748368.121737:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788748368.124716:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377046528:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.621362:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377047168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748368.621432:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748368.621563:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047168 00000100:00100000:2.0:1788748368.621572:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047168 00000100:00100000:2.0:1788748368.621624:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748368.621635:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377047168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748368.621670:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748368.621735:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377047168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748368.621743:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788748368.621770:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceed61d500 x1875638377047168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748368.621789:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377047168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748369.005821:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748369.133316:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748369.133342:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748369.133417:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748369.133568:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047296 00000100:00100000:2.0:1788748369.133576:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047296 00000100:00100000:2.0:1788748369.133626:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748369.133636:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377047296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748369.133678:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748369.133736:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377047296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748369.133743:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748369.133838:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377047296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748370.029340:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748371.053349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748372.007586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748372.007651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748372.007889:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138752 00000100:00100000:0.0:1788748372.007899:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138752 00000100:00100000:0.0:1788748372.007978:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:0.0:1788748372.007990:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358138752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748372.008087:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358138752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748372.008095:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00080000:3.0:1788748372.008171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748372.008378:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138624 00000100:00100000:2.0:1788748372.008383:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138624 00000100:00100000:2.0:1788748372.008420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 277 00000100:00100000:2.0:1788748372.008428:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358138624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748372.008469:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358138624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748372.008476:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 277 00000100:00100000:1.0:1788748372.013326:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748372.013412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748372.013896:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139008 00000100:00100000:0.0:1788748372.013907:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139008 00000100:00100000:0.0:1788748372.013986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:0.0:1788748372.014006:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358139008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748372.014098:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358139008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 103us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748372.014105:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00080000:1.0:1788748372.014362:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748372.015546:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358138880 00000100:00100000:3.0:1788748372.015620:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358138880 00000100:00100000:3.0:1788748372.015804:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788748372.015814:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2346:x1875638358138880:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1788748372.015841:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c109 00000100:00080000:3.0:1788748372.015862:0:6697:0:(import.c:65:import_set_state_nolock()) ffff99cefd850800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748372.015907:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788748372.016215:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+2:2346:x1875638358138880:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 402us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748372.016223:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:2.0:1788748372.016300:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748372.017893:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788748372.077643:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748373.101546:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748373.233630:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377047424:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.233698:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748373.233792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047424 00000100:00100000:1.0:1788748373.233800:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047424 00000100:00100000:1.0:1788748373.233848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788748373.233857:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377047424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234048:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377047552:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234079:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748373.234101:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748373.234120:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377047680:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748373.234455:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047552 00000100:00100000:0.0:1788748373.234460:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047552 00000100:00100000:0.0:1788748373.234488:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047680 00000100:00100000:0.0:1788748373.234490:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047680 00000100:00100000:0.0:1788748373.234515:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748373.234521:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234559:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377047552:12345-0@lo:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748373.234565:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748373.234580:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788748373.234586:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377047680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234612:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377047680:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748373.234618:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788748373.234653:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377047680:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.234663:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377047552:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.234723:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377047808:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.234755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748373.234824:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047808 00000100:00100000:2.0:1788748373.234827:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047808 00000100:00100000:2.0:1788748373.234854:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748373.234861:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377047808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.234893:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377047808:12345-0@lo:400:kworker.0 Request processed in 33us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748373.234906:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748373.234933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377047808:0@lo:400:kworker.0 00000100:00080000:2.0:1788748373.234953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748373.234958:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748373.238064:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377047424:12345-0@lo:400:kworker.0 Request processed in 4199us (4357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748373.238079:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788748373.238514:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.238560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.238603:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048064 00000100:00100000:3.0:1788748373.238611:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048064 00000100:00100000:3.0:1788748373.238657:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748373.238665:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377048064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.238710:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377048064:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.238715:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788748373.238752:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ced2ad4700 x1875638377048064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748373.238767:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377048064:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.238834:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748373.238843:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377047936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.238870:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748373.238903:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748373.238984:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377047936 00000100:00100000:3.0:1788748373.238988:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377047936 00000100:00100000:3.0:1788748373.239314:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788748373.239321:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377047936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.239363:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377047936:12345-0@lo:400:kworker.0 Request processed in 43us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.239369:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788748373.239406:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377047936:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.239663:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377047424:0@lo:400:kworker.0 00000100:00080000:2.0:1788748373.239721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748373.741538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748373.741564:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748373.741641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748373.741740:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048192 00000100:00100000:2.0:1788748373.741749:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048192 00000100:00100000:2.0:1788748373.741807:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788748373.741816:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377048192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748373.741851:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748373.741908:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377048192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748373.741914:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788748373.741987:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceed61dc00 x1875638377048192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748373.742065:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377048192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748374.125466:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748374.253707:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748374.253784:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748374.254681:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048320 00000100:00100000:3.0:1788748374.254690:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048320 00000100:00100000:3.0:1788748374.255424:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788748374.255437:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377048320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748374.255474:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748374.255553:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377048320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748374.255559:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788748374.255644:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377048320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748375.150198:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748375.869735:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:0.0:1788748375.869744:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cefd853800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:3.0:1788748375.872413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd853800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-OST0000 00000020:00000080:3.0:1788748375.875851:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd850800 for lustre-OST0000 00010000:00010000:1.0:1788748376.174156:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748377.008433:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748377.123741:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748377.123779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748377.123840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748377.123870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139264 00000100:00100000:0.0:1788748377.123879:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139264 00000100:00100000:0.0:1788748377.123932:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139392 00000100:00100000:0.0:1788748377.123935:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139392 00000100:00100000:0.0:1788748377.123954:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1788748377.123961:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358139264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748377.124053:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358139264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748377.124060:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1788748377.124078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1788748377.124085:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358139392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748377.124110:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358139392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748377.124116:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00080000:0.0:1788748377.124142:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748377.131399:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139136 00000100:00100000:3.0:1788748377.131414:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139136 00000100:00100000:3.0:1788748377.132941:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 279 00000100:00100000:3.0:1788748377.132956:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358139136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748377.133933:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358139136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 974us (10145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748377.133944:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 279 00010000:00010000:2.0:1788748377.197300:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748378.223457:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748378.301465:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:32:56 (1788748376) 00000100:00100000:2.0:1788748378.349419:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377048448:0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.349533:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377048960:0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349565:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.349592:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748378.349597:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377048832:0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349618:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748378.349634:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048960 00000100:00100000:0.0:1788748378.349642:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048960 00000100:00100000:2.0:1788748378.349659:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377048576:0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.349691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748378.349701:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748378.349701:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377048960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349719:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377049088:0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.349767:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748378.349773:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377048704:0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.349793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.349956:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048448 00000100:00100000:2.0:1788748378.349960:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048448 00000100:00100000:2.0:1788748378.349987:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788748378.349994:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.349994:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377048960:12345-0@lo:400:kworker.0 Request processed in 295us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748378.350001:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788748378.350033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048576 00000100:00100000:0.0:1788748378.350036:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048576 00000100:00100000:0.0:1788748378.350055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048704 00000100:00100000:2.0:1788748378.350057:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3309:x1875638377048448:12345-0@lo:400:kworker.0 Request processed in 64us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748378.350058:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048704 00000100:00100000:2.0:1788748378.350063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788748378.350070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788748378.350074:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377048576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.350092:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377048832 00000100:00100000:2.0:1788748378.350095:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377048832 00000100:00100000:0.0:1788748378.350106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377048576:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748378.350112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788748378.350130:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377049088 00000100:00100000:2.0:1788748378.350133:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377049088 00000100:00100000:0.0:1788748378.350143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788748378.350148:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377048704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.350154:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788748378.350159:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.350172:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377048704:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748378.350178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788748378.350182:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377048832:12345-0@lo:400:kworker.0 Request processed in 23us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748378.350187:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788748378.350194:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748378.350197:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748378.350200:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748378.350202:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788748378.350208:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377049088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748378.350232:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377049088:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748378.350238:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748378.350298:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377048704:0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.350309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377048576:0@lo:400:kworker.0 00010000:00080000:0.0:1788748378.350319:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceed61d500 x1875638377049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.350330:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377049088:0@lo:400:kworker.0 00000100:00100000:3.0:1788748378.353952:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788748378.353984:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377048832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748378.353996:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377048448:0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.862141:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748378.862246:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377049216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748378.862412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.863869:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377049216 00000100:00100000:1.0:1788748378.863885:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377049216 00000100:00100000:1.0:1788748378.863976:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748378.863987:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377049216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748378.864091:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748378.864193:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377049216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.864200:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788748378.864426:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ceecddd880 x1875638377049216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.864488:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377049216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788748379.245529:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748379.375102:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748379.375153:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748379.375248:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748379.375493:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377049344 00000100:00100000:1.0:1788748379.375503:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377049344 00000100:00100000:1.0:1788748379.375575:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748379.375586:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377049344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748379.375654:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748379.375723:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377049344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748379.375731:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748379.376206:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748379.689173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748379.698336:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139520 00000100:00100000:2.0:1788748379.698360:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139520 00000100:00100000:2.0:1788748379.698558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788748379.698575:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:10231:x1875638358139520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748379.700799:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748379.700841:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521641 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.701291:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.701310:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.701327:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748379.701378:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748379.701382:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748379.701433:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.701466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521641 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.702737:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521641 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748379.702756:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646200) 00010000:00010000:2.0:1788748379.702760:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748379.702765:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:2.0:1788748379.702856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:10231:x1875638358139520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 4286us (13694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748379.702867:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00080000:1.0:1788748379.707662:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748379.710145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748379.710267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139648 00000100:00100000:0.0:1788748379.710280:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139648 00000100:00100000:0.0:1788748379.710356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748379.710368:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:10232:x1875638358139648:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748379.710397:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748379.710422:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c1e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521648 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710513:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710530:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710544:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710561:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710567:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.710880:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711218:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711230:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711240:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748379.711278:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788748379.711282:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748379.711308:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711321:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711329:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711343:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748379.711348:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711356:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711381:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646200) 00010000:00010000:0.0:1788748379.711384:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748379.711391:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711398:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c1e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711413:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711419:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711425:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711431:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748379.711434:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711440:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711448:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cec3e09e00) 00010000:00010000:0.0:1788748379.711451:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748379.711454:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711460:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c1f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711525:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c1e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521648 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711541:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521648 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748379.711549:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec3e09400) 00010000:00010000:0.0:1788748379.711551:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748379.711553:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5800, rc 0) 00000100:00100000:0.0:1788748379.711946:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:10232:x1875638358139648:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1577us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748379.711956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748379.718927:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748379.719048:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358139904 00000100:00100000:3.0:1788748379.719062:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358139904 00000100:00100000:3.0:1788748379.719150:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788748379.719173:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:10232:x1875638358139904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748379.719202:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748379.719228:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c1fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652164f expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.719324:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.719341:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.719354:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724379:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724414:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724427:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724846:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c213 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724857:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.724876:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748379.724962:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788748379.725154:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725162:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725168:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725175:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748379.725179:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725186:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725198:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec3e09400) 00010000:00010000:3.0:1788748379.725201:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748379.725206:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725211:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c205 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725224:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725230:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725243:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725248:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748379.725251:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725257:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725264:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cec9769f00) 00010000:00010000:3.0:1788748379.725267:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748379.725270:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725275:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c20c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725735:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c1fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652164f expref: 10 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725752:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c213 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652164f expref: 9 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748379.725760:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:3.0:1788748379.725762:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748379.725764:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43800, rc 0) 00000100:00100000:3.0:1788748379.725836:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10232:x1875638358139904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 6675us (6923us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788748379.725854:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788748379.732891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748379.733088:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140032 00000100:00100000:2.0:1788748379.733113:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140032 00000100:00100000:2.0:1788748379.733191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788748379.733202:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10232:x1875638358140032:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788748379.733324:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10232:x1875638358140032:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 123us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748379.733330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000040:00080000:1.0:1788748380.078127:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748380.273111:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748380.952487:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788748381.294345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748381.887342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748381.887401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140160 00000100:00100000:2.0:1788748381.887411:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140160 00000100:00100000:2.0:1788748381.887478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1788748381.887487:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10275:x1875638358140160:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748381.887506:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748381.887526:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521656 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887613:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887623:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887637:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887643:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887650:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887841:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887848:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887854:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887859:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748381.887863:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887878:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887889:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646200) 00010000:00010000:2.0:1788748381.887892:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748381.887897:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887903:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887914:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887920:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887926:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887932:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748381.887935:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887950:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887958:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cec6646800) 00010000:00010000:2.0:1788748381.887961:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748381.887964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.887978:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c22f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.888035:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c221 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521656 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.888045:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646200) 00010000:00010000:2.0:1788748381.888048:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748381.888052:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521656 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.888061:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2000, rc 0) 00000100:00100000:2.0:1788748381.888127:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10275:x1875638358140160:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 640us (791us total) trans 0 rc 301/301 00000100:00100000:2.0:1788748381.888133:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00080000:1.0:1788748381.888436:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748381.900665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748381.902231:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140416 00000100:00100000:3.0:1788748381.902243:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140416 00000100:00100000:3.0:1788748381.902306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1788748381.902317:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10275:x1875638358140416:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1788748381.902372:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748381.902398:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c1db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521641 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902416:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646200) 00010000:00010000:3.0:1788748381.902428:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748381.902635:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902649:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902660:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902673:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902681:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.902688:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748381.909306:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788748381.909327:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909338:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909347:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909354:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748381.909358:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909366:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909380:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769500) 00010000:00010000:3.0:1788748381.909384:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748381.909388:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.909395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c236 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748381.909415:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000087838eef reply state 0000000036d1a73a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748381.909424:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748381.909779:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10275:x1875638358140416:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 7460us (9118us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788748381.909799:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00010000:00010000:3.0:1788748381.914299:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914318:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914327:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914334:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748381.914339:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914347:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914364:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cec9769000) 00010000:00010000:3.0:1788748381.914368:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748381.914374:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748381.914379:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c23d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748381.983163:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748381.983400:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140544 00000100:00100000:2.0:1788748381.983411:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140544 00000100:00100000:2.0:1788748381.983465:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748381.983476:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10283:x1875638358140544:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:2.0:1788748381.983501:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748381.983523:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652165d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983597:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983612:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983638:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748381.983675:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748381.983678:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748381.983717:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983741:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652165d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983758:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652165d expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748381.983767:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:2.0:1788748381.983770:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748381.983774:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2600, rc 0) 00000100:00100000:2.0:1788748381.983844:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10283:x1875638358140544:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 370us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748381.983852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748382.042846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.043067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140672 00000100:00100000:1.0:1788748382.043076:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140672 00000100:00100000:1.0:1788748382.043146:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748382.043157:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10289:x1875638358140672:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748382.043178:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.043198:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521664 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043259:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043274:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043285:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043320:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043328:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043335:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043438:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043574:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043584:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748382.043622:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788748382.043626:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748382.043662:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043681:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043688:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043704:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748382.043708:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043716:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043729:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:1.0:1788748382.043732:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748382.043738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043758:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043765:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043771:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043777:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748382.043780:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043786:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043803:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cecfaefa00) 00010000:00010000:1.0:1788748382.043806:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748382.043809:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043815:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c260 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043847:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521664 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043861:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521664 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.043868:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748382.043871:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788748382.043873:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9800, rc 0) 00000100:00100000:1.0:1788748382.044120:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:10289:x1875638358140672:12345-192.168.203.4@tcp:101:bash.0 Request processed in 964us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.044128:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788748382.051453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748382.051520:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358140928 00000100:00100000:3.0:1788748382.051529:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358140928 00000100:00100000:3.0:1788748382.051582:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1788748382.051593:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:10289:x1875638358140928:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748382.051615:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748382.051649:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c26e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652166b expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051777:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051790:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051800:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051816:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051822:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.051828:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748382.052459:0:8052:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788748382.052598:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052608:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052616:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052646:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052664:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052727:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052733:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748382.052737:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052744:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052754:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748382.052757:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748382.052761:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052767:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c275 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748382.052779:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000084a9c337 reply state 000000007dc091c9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748382.052786:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788748382.052813:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c26e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 13 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052825:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 12 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.052841:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:3.0:1788748382.052844:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748382.052846:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748382.052916:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10289:x1875638358140928:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1325us (1471us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788748382.052923:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00010000:00010000:3.0:1788748382.056799:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056816:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056823:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056830:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748382.056835:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056842:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056857:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec9769000) 00010000:00010000:3.0:1788748382.056860:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748382.056864:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.056871:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c27c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748382.058275:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.058359:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141056 00000100:00100000:2.0:1788748382.058374:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141056 00000100:00100000:2.0:1788748382.058419:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748382.058427:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875638358141056:12345-192.168.203.4@tcp:8:bash.0 00010000:00080000:2.0:1788748382.058456:0:6695:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1788748382.058495:0:6695:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7c291 00002000:00100000:2.0:1788748382.058516:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7b6e58be-3dc9-4518-a85f-e723d86d70a3/ffff99cee52f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788748382.058540:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788748382.058768:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788748382.058796:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99cee52fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748382.058862:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358141056:12345-192.168.203.4@tcp:8:bash.0 Request processed in 433us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.058870:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748382.062454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.062774:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141184 00000100:00100000:2.0:1788748382.062784:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141184 00000100:00080000:1.0:1788748382.062900:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748382.062943:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788748382.062954:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:0:x1875638358141184:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748382.062972:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.062994:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521672 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748382.063037:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748382.063055:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1788748382.063060:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748382.063071:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.063103:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.063117:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2000, rc 0) 00000100:00100000:2.0:1788748382.063173:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:0:x1875638358141184:12345-192.168.203.4@tcp:101:bash.0 Request processed in 220us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.063187:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748382.067526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.067690:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141312 00000100:00100000:2.0:1788748382.067699:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141312 00000100:00100000:2.0:1788748382.067749:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788748382.067758:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:10289:x1875638358141312:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748382.067774:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.067791:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521679 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.067819:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.067827:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748382.067831:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748382.067835:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.067865:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.067878:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 8 pid: 6697 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.067892:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377049472:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748382.067984:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748382.071555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.071718:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141440 00000100:00100000:1.0:1788748382.071733:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141440 00010000:00010000:1.0:1788748382.071777:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 9 pid: 6697 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.071821:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:1.0:1788748382.071842:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358141440:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748382.071863:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748382.071885:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 9 pid: 6697 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.071898:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 9 pid: 6697 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.071923:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748382.071928:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748382.071937:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.071947:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.071984:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.071998:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377049600:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748382.072129:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefff0a000 going to sleep for 11 seconds 00010000:00010000:2.0:1788748382.073065:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521672 expref: 9 pid: 6697 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.073102:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377049472:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748382.073126:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.073138:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2800, rc 0) 00000100:00100000:2.0:1788748382.073196:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10289:x1875638358141312:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5438us (5678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.073204:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748382.077373:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377049600:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788748382.077400:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748382.077458:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358141440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5616us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.077493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788748382.081135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.081273:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141696 00000100:00100000:1.0:1788748382.081283:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141696 00000100:00100000:1.0:1788748382.081337:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748382.081347:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:10289:x1875638358141696:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788748382.081868:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10289:x1875638358141696:12345-192.168.203.4@tcp:35:bash.0 Request processed in 520us (740us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788748382.081876:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788748382.181351:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.181505:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358141952 00000100:00100000:2.0:1788748382.181514:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358141952 00000100:00100000:2.0:1788748382.181574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788748382.181585:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10299:x1875638358141952:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748382.181609:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.181628:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521680 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748382.181713:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788748382.181830:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521680 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.181844:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:2.0:1788748382.181848:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748382.181854:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521680 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.181885:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2000, rc 0) 00000100:00100000:2.0:1788748382.181993:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10299:x1875638358141952:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 409us (651us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788748382.182000:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:0.0:1788748382.186604:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.186687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358142208 00000100:00100000:1.0:1788748382.186697:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358142208 00000100:00100000:1.0:1788748382.186753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748382.186763:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10299:x1875638358142208:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748382.186990:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10299:x1875638358142208:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 227us (392us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788748382.186998:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748382.251305:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748382.251348:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748382.251436:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358142336 00000100:00100000:3.0:1788748382.251447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358142336 00000100:00100000:3.0:1788748382.251510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:3.0:1788748382.251520:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358142336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748382.251598:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358142336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748382.251606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:1.0:1788748382.251780:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358142464 00000100:00100000:1.0:1788748382.251785:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358142464 00000100:00100000:1.0:1788748382.251835:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:1.0:1788748382.251842:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358142464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748382.251906:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358142464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.251912:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00080000:3.0:1788748382.252051:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748382.258468:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.258577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358142592 00000100:00100000:2.0:1788748382.258586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358142592 00000100:00100000:2.0:1788748382.258639:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1788748382.258648:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10305:x1875638358142592:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748382.258670:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.258691:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521687 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258753:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258777:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748382.258808:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788748382.258811:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748382.258828:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258851:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521687 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258898:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521687 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.258906:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748382.258909:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748382.258913:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3c00, rc 0) 00000100:00100000:2.0:1788748382.258962:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:10305:x1875638358142592:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 316us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.258967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788748382.264413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.264506:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358142848 00000100:00100000:1.0:1788748382.264516:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358142848 00000100:00100000:1.0:1788748382.264586:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1788748382.264609:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:10305:x1875638358142848:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748382.264629:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.264647:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652168e expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.264741:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.264755:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.264766:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748382.264777:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788748382.264909:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652168e expref: 19 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.264926:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652168e expref: 18 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.264935:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:1.0:1788748382.264937:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748382.264941:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748382.265006:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10305:x1875638358142848:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 399us (602us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788748382.265045:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788748382.269325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748382.269368:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.269442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143104 00000100:00100000:2.0:1788748382.269452:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143104 00000100:00100000:2.0:1788748382.269520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788748382.269531:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10305:x1875638358143104:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748382.269554:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.269761:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521695 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.269867:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.269882:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.269892:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748382.269905:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788748382.270074:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c2d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521695 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.270104:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521695 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.270112:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:2.0:1788748382.270115:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788748382.270119:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748382.270461:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:10305:x1875638358143104:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 931us (1143us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788748382.270469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788748382.270918:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143232 00000100:00100000:1.0:1788748382.270924:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143232 00000100:00100000:1.0:1788748382.271007:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788748382.271037:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:2348:x1875638358143232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748382.271048:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748382.271063:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652168e expref: 20 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.271076:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:1.0:1788748382.271080:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748382.271118:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:2348:x1875638358143232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 105us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.271124:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788748382.276636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.276724:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143360 00000100:00100000:2.0:1788748382.276734:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143360 00000100:00100000:2.0:1788748382.276788:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788748382.276798:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358143360:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1788748382.276851:0:8053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.276870:0:8053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.276879:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748382.276883:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748382.276888:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.276916:0:8053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.276937:0:8053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 7 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.276948:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8053:1875638377049728:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748382.277030:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748382.279263:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8053:1875638377049728:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748382.279307:0:8053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748382.279416:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.279512:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143488 00000100:00100000:1.0:1788748382.279519:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143488 00002000:00100000:1.0:1788748382.279560:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99cef7270700 x1875638358143488/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:128/0 lens 504/0 e 0 to 0 dl 1788748393 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748382.279570:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7270700 with x1875638358143488 ext(0->12) 00010000:00010000:1.0:1788748382.279577:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 8 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.279590:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 8 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748382.279598:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cef7270700 00000100:00100000:1.0:1788748382.279628:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788748382.279699:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358143488:12345-192.168.203.4@tcp:4:lfs.0 00000001:00100000:3.0:1788748382.302804:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000100:00100000:1.0:1788748382.304105:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358143488:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 24452us (24672us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788748382.304128:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:1.0:1788748382.304143:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99cef7270700 x1875638358143488/t4294967299(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:128/0 lens 504/448 e 0 to 0 dl 1788748393 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748382.304154:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7270700 with x1875638358143488 ext(0->12) 00010000:00010000:1.0:1788748382.304164:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.304183:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748382.304191:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cef7270700 00000100:00100000:0.0:1788748382.308117:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.308217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143616 00000100:00100000:1.0:1788748382.308228:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143616 00010000:00010000:1.0:1788748382.308266:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.308306:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1788748382.308315:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2350:x1875638358143616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748382.308330:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788748382.308347:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788748382.308350:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788748381 00002000:00010000:1.0:1788748382.308352:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788748381 00002000:00010000:1.0:1788748382.308354:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788748381 00010000:00010000:1.0:1788748382.308360:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.308385:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.308408:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c29f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521679 expref: 9 pid: 6695 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.308426:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748382.308430:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748382.308436:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.308446:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.308478:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748382.308542:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2350:x1875638358143616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 227us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.308550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00010000:00010000:2.0:1788748382.308624:0:8053:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308643:0:8053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308668:0:8053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308676:0:8053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308685:0:8053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308705:0:8053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748382.308710:0:8053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308719:0:8053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308731:0:8053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.308739:0:8053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ceceaeb/0x5b377f42a7a7c2ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.308804:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358143360:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 32007us (32176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.308812:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1788748382.312318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.312493:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358143872 00000100:00100000:1.0:1788748382.312502:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358143872 00000100:00100000:1.0:1788748382.312557:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748382.312567:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:10305:x1875638358143872:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:1.0:1788748382.312625:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521695 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748382.312913:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788748382.312968:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788748382.316864:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788748382.316952:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.316972:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 23 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.316981:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.317038:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 23 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.317054:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 23 pid: 8052 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.317069:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377049856:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748382.317454:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748382.318823:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748382.323453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.323776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358144000 00000100:00100000:2.0:1788748382.323786:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358144000 00010000:00010000:2.0:1788748382.323827:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 24 pid: 8052 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.323869:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788748382.324180:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:2348:x1875638358144000:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748382.324196:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748382.324203:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 24 pid: 8052 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.324228:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 24 pid: 8052 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.324249:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:2.0:1788748382.324255:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.324266:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.324274:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.324292:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748382.324311:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652166b expref: 24 pid: 8052 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.324331:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377049856:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748382.324344:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:2348:x1875638358144000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (898us total) trans 0 rc 0/0 00010000:00010000:1.0:1788748382.324351:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.324352:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00010000:00010000:1.0:1788748382.324380:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.324386:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748382.325204:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788748382.325799:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788748382.325952:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7270380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377049984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748382.326009:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748382.326264:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748382.326385:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377049984 00000100:00100000:1.0:1788748382.326393:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377049984 00000100:00100000:1.0:1788748382.326493:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748382.326502:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377049984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788748382.326663:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377049984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.326671:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748382.326733:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7270380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377049984:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788748382.326762:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788748382.327375:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788748382.327436:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7270380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377050112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748382.327469:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748382.327980:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd74d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748382.328144:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377050112 00000100:00100000:2.0:1788748382.328151:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377050112 00000100:00100000:3.0:1788748382.328344:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748382.328352:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377050112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748382.328581:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1875638377050112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (1110us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788748382.328588:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748382.328801:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7270380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377050112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748382.328854:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788748382.328893:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328903:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328911:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328916:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748382.328920:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328928:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328942:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:0.0:1788748382.328955:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788748382.328960:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.328966:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c2f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748382.329398:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788748382.329786:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788748382.329798:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299372783100ns, next at 300372781118ns, rc = 0 00000001:00080000:0.0:1788748382.329806:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788748382.329845:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769500) 00010000:00010000:0.0:1788748382.329849:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748382.329856:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c2de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521695 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748382.329963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:10305:x1875638358143872:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 17397us (17654us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788748382.329975:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000020:00080000:0.0:1788748382.329979:0:5848:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788748382.334644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.334753:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358144128 00000100:00100000:1.0:1788748382.334762:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358144128 00000100:00100000:1.0:1788748382.334814:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748382.334825:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:10305:x1875638358144128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748382.334852:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.334873:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652169c expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.334929:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652169c expref: 27 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.334943:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652169c expref: 27 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.334978:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748382.334981:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748382.334985:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9a00, rc 0) 00000100:00100000:1.0:1788748382.335066:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:10305:x1875638358144128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 242us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.335073:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1788748382.339664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.339794:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358144384 00000100:00100000:1.0:1788748382.339803:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358144384 00000100:00100000:1.0:1788748382.339855:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748382.339865:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:10305:x1875638358144384:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748382.340158:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+28:10305:x1875638358144384:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 294us (502us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788748382.340167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788748382.420765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.421246:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358144640 00000100:00100000:1.0:1788748382.421256:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358144640 00000100:00100000:1.0:1788748382.421314:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1788748382.421325:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+28:10315:x1875638358144640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748382.421349:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.421368:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c301 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748382.421455:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788748382.421578:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c301 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216a3 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.421611:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:1.0:1788748382.421614:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748382.421958:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216a3 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.421975:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748382.422072:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10315:x1875638358144640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 748us (1317us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788748382.422080:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788748382.425138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.425231:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358144768 00000100:00100000:1.0:1788748382.425241:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358144768 00000100:00100000:1.0:1788748382.425343:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1788748382.425354:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10315:x1875638358144768:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1788748382.425424:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425440:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425451:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425466:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425474:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425497:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425580:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425588:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425595:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748382.425637:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425649:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425655:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425673:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425681:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748382.425685:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425693:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425704:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748382.425713:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748382.425730:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425737:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c30f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425753:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425759:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425766:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425771:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748382.425773:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425779:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425786:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cecfaefa00) 00010000:00010000:1.0:1788748382.425789:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748382.425792:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425798:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425813:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425825:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425831:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425835:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748382.425838:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425844:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425851:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748382.425853:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748382.425857:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.425863:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c31d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.425934:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10315:x1875638358144768:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 582us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.425941:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1788748382.430301:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.430766:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358145024 00000100:00100000:1.0:1788748382.430776:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358145024 00000100:00100000:1.0:1788748382.430829:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748382.430839:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10315:x1875638358145024:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748382.431076:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:10315:x1875638358145024:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 239us (784us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788748382.431106:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748382.474282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.475142:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358145280 00000100:00100000:2.0:1788748382.475154:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358145280 00000100:00100000:2.0:1788748382.475216:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1788748382.475226:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:10318:x1875638358145280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748382.475252:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748382.475274:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c324 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216aa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475354:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475367:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475375:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475386:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475390:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475395:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475482:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475489:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475496:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748382.475505:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788748382.475594:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475602:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475614:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475620:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748382.475624:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475631:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475643:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748382.475645:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748382.475651:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475657:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c32b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475670:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475677:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475682:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475686:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748382.475688:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475703:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475711:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646d00) 00010000:00010000:2.0:1788748382.475713:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748382.475716:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.475974:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.476010:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c324 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.476062:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.476069:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748382.476072:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748382.476074:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748382.476195:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10318:x1875638358145280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 970us (1922us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788748382.476202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1788748382.480860:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.480907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358145408 00000100:00100000:2.0:1788748382.480918:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358145408 00000100:00100000:2.0:1788748382.480972:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:2.0:1788748382.480982:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10318:x1875638358145408:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788748382.481114:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481130:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481141:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481178:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481186:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481194:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481200:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748382.481204:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481212:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481223:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748382.481226:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748382.481232:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.481238:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.481326:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10318:x1875638358145408:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 346us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748382.481334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788748382.485083:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.485169:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358145664 00000100:00100000:1.0:1788748382.485179:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358145664 00000100:00100000:1.0:1788748382.485269:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1788748382.485280:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10318:x1875638358145664:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748382.485522:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:10318:x1875638358145664:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 243us (448us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788748382.485530:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748382.751433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.751682:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358145920 00000100:00100000:1.0:1788748382.751695:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358145920 00000100:00100000:1.0:1788748382.751787:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788748382.751799:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:10349:x1875638358145920:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1788748382.751832:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.751858:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c34e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.751991:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.752009:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.752079:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748382.752104:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788748382.752433:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c34e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b1 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.752493:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b1 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.752504:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748382.752507:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748382.752511:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8400, rc 0) 00000100:00100000:1.0:1788748382.752805:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10349:x1875638358145920:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1006us (1386us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788748382.752813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788748382.760912:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748382.760963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.761075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358146304 00000100:00100000:1.0:1788748382.761102:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358146304 00000100:00100000:1.0:1788748382.761223:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748382.761236:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5228c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:2347:x1875638358146304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748382.761268:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748382.761301:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b1 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.761325:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748382.761331:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748382.761406:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5228c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:2347:x1875638358146304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 173us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748382.761414:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788748382.761773:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358146176 00000100:00100000:0.0:1788748382.761780:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358146176 00000100:00100000:0.0:1788748382.763430:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748382.763458:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:10349:x1875638358146176:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1788748382.763796:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10349:x1875638358146176:12345-192.168.203.4@tcp:35:cat.0 Request processed in 350us (2892us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788748382.763804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748382.857820:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.857989:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358146560 00000100:00100000:1.0:1788748382.857999:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358146560 00000100:00100000:1.0:1788748382.858099:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1788748382.858111:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10355:x1875638358146560:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1788748382.858145:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748382.858148:0:8052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788748382.858173:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521687 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860099:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748382.860111:0:8052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748382.860135:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c363 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216b8 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860421:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860437:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860444:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860593:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.860611:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 35 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748382.860624:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377050240:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748382.860766:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748382.871198:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748382.871277:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377050240:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748382.871303:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358146688 00000100:00100000:0.0:1788748382.871316:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358146688 00010000:00010000:1.0:1788748382.871329:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871374:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 36 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748382.871425:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788748382.871438:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:2347:x1875638358146688:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748382.871462:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748382.871471:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 36 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871495:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 36 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871524:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216aa expref: 36 pid: 5846 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871546:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:0.0:1788748382.871552:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871573:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871582:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748382.871615:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748382.871649:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.871658:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748382.871686:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788748382.871874:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c363 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 37 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.871896:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 36 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748382.871904:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748382.871907:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748382.871911:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9e00, rc 0) 00000100:00100000:0.0:1788748382.871917:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:2347:x1875638358146688:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 478us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748382.871929:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788748382.871986:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10355:x1875638358146560:12345-192.168.203.4@tcp:101:dd.0 Request processed in 13876us (14173us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788748382.871999:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788748382.879241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748382.880426:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358146944 00000100:00100000:2.0:1788748382.880442:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358146944 00000100:00100000:2.0:1788748382.880538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1788748382.880549:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10355:x1875638358146944:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1788748382.881145:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.881168:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748382.881182:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748382.881245:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788748382.881272:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000dd92656b reply state 0000000075821f6b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748382.881283:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748382.881431:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:10355:x1875638358146944:12345-192.168.203.4@tcp:36:dd.0 Request processed in 880us (2201us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788748382.881438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000020:00080000:2.0:1788748382.881445:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748382.883327:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883348:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883357:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883364:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748382.883374:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883392:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883412:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:3.0:1788748382.883416:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748382.883422:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748382.883428:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748383.174869:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.175806:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358147072 00000100:00100000:2.0:1788748383.175825:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358147072 00000100:00100000:2.0:1788748383.175984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788748383.175995:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:10368:x1875638358147072:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:2.0:1788748383.176058:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748383.176096:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c37f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216bf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177074:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177102:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177122:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177130:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177137:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177262:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177278:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 38 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177286:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177335:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 38 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.177367:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 38 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748383.177671:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377050368:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748383.177895:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00080000:3.0:1788748383.178122:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748383.182099:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.182202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358147328 00000100:00100000:1.0:1788748383.182214:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358147328 00000100:00100000:1.0:1788748383.182285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748383.182297:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:5588:x1875638358147328:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788748383.183618:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:5588:x1875638358147328:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 1313us (1531us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788748383.183647:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788748383.186328:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377050368:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748383.186372:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748383.186719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.186810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358147456 00000100:00100000:1.0:1788748383.186821:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358147456 00010000:00010000:1.0:1788748383.186872:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 40 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.186964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748383.186976:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:2348:x1875638358147456:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748383.186996:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748383.187004:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 40 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187041:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 40 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187068:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c36a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216b8 expref: 40 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187097:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748383.187103:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187113:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187122:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.187459:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748383.187672:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:2348:x1875638358147456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 694us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748383.187681:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:0.0:1788748383.188920:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.188938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748383.189006:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788748383.189043:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748383.189116:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189147:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189154:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189174:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189182:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748383.189187:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189212:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189231:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748383.189235:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748383.189242:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189249:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189268:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189275:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189282:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189288:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748383.189291:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189297:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189305:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646d00) 00010000:00010000:0.0:1788748383.189307:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748383.189311:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c38d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189449:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c37f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216bf expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189470:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216bf expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.189540:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:0.0:1788748383.189544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748383.189547:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:0.0:1788748383.189710:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:10368:x1875638358147072:12345-192.168.203.4@tcp:101:stat.0 Request processed in 13715us (14853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.189720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1788748383.270320:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.270671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358147712 00000100:00100000:1.0:1788748383.270685:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358147712 00000100:00100000:1.0:1788748383.270759:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788748383.270770:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:10375:x1875638358147712:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:1.0:1788748383.270844:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748383.270879:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216bf expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.270903:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748383.270909:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748383.271252:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.271270:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.271282:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748383.271341:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788748383.271370:0:5845:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d7936f18 reply state 00000000915e38f7 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.271380:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748383.271550:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:10375:x1875638358147712:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 779us (1245us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788748383.271840:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000020:00080000:1.0:1788748383.271848:0:5845:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788748383.279879:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279903:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279912:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279919:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748383.279924:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279933:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279954:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748383.279958:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748383.279964:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.279971:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c39b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.347721:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748383.471989:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377050752:0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.472107:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748383.472170:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788748383.472207:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.472276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377050880:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.472318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.472364:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788748383.472371:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377050496:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.472402:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.472428:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377051008:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.472462:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377050880 00000100:00100000:3.0:1788748383.472472:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377050880 00000100:00100000:3.0:1788748383.472888:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748383.472900:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377050880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.472980:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377050880:12345-0@lo:400:kworker.0 Request processed in 81us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.472989:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748383.473059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377050496 00000100:00100000:3.0:1788748383.473063:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377050496 00000100:00100000:3.0:1788748383.473104:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788748383.473111:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377050496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.473157:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377050496:12345-0@lo:400:kworker.0 Request processed in 47us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.473163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1788748383.473199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748383.478317:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377051136:0@lo:400:kworker.0 00000100:00100000:1.0:1788748383.478749:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748383.478817:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377051136 00000100:00100000:1.0:1788748383.478828:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377051136 00000100:00100000:1.0:1788748383.478892:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748383.478903:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875638377051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748383.478971:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875638377051136:12345-0@lo:400:kworker.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748383.478980:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748383.479064:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377051136:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.479368:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.490667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377050880:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.490715:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377050496:0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495347:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377050752 00000100:00100000:2.0:1788748383.495374:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377050752 00000100:00100000:2.0:1788748383.495504:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377050624 00000100:00100000:2.0:1788748383.495508:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377050624 00000100:00100000:2.0:1788748383.495519:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377051008 00000100:00100000:2.0:1788748383.495522:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377051008 00000100:00100000:2.0:1788748383.495542:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788748383.495564:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495690:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377050752:12345-0@lo:400:kworker.0 Request processed in 138us (23583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.495698:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788748383.495760:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377050752:0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495797:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788748383.495803:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377050624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495841:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377050624:12345-0@lo:400:kworker.0 Request processed in 39us (23633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.495846:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788748383.495891:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377050624:0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495908:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788748383.495913:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748383.495944:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377051008:12345-0@lo:400:kworker.0 Request processed in 31us (16578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.495950:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788748383.496490:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748383.496524:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377051008:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.500907:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.501055:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358147840 00000100:00100000:2.0:1788748383.501066:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358147840 00000100:00100000:2.0:1788748383.501135:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1788748383.501145:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:10389:x1875638358147840:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:2.0:1788748383.501192:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748383.501213:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c3a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216c6 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501277:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501293:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501305:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501322:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501329:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501335:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501447:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501456:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501463:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748383.501501:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788748383.501505:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748383.501796:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501810:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501818:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501825:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501832:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501839:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.501842:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501850:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501868:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748383.501871:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.501876:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501883:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c3a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501897:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501903:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501910:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501915:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.501918:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501923:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501929:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646e00) 00010000:00010000:2.0:1788748383.501932:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.501934:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501940:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c3b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501977:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c3a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 41 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501990:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 40 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.501998:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748383.502000:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748383.502002:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2800, rc 0) 00000100:00100000:2.0:1788748383.502312:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:10389:x1875638358147840:12345-192.168.203.4@tcp:101:stat.0 Request processed in 1167us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.502319:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788748383.611733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748383.612791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358148096 00000100:00100000:0.0:1788748383.612809:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358148096 00000100:00100000:0.0:1788748383.612899:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788748383.612911:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:10399:x1875638358148096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748383.612939:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748383.612964:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c3be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216cd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748383.613153:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788748383.613324:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c3be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216cd expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.613563:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:0.0:1788748383.613567:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748383.613573:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c3be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216cd expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.613591:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5c00, rc 0) 00000100:00100000:0.0:1788748383.613767:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+41:10399:x1875638358148096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 857us (2047us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788748383.613776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788748383.622372:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.623681:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358148352 00000100:00100000:1.0:1788748383.623699:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358148352 00000100:00100000:1.0:1788748383.623846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788748383.623861:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+41:10399:x1875638358148352:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748383.624278:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+42:10399:x1875638358148352:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 419us (1918us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788748383.624287:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748383.705254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.705388:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358148608 00000100:00100000:1.0:1788748383.705402:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358148608 00000100:00100000:1.0:1788748383.705521:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1788748383.705534:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+42:10405:x1875638358148608:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748383.705567:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748383.705594:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c3cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216d4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.705773:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.705817:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.705829:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.705893:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.705911:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 43 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.705927:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377051264:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748383.706268:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748383.713278:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.713465:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377051264:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748383.713502:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748383.713602:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358148736 00000100:00100000:3.0:1788748383.713612:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358148736 00010000:00010000:3.0:1788748383.713670:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 44 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748383.713712:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1788748383.713723:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:2347:x1875638358148736:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748383.713741:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748383.713748:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 44 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713762:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 44 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c3b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216c6 expref: 44 pid: 8052 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713810:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:3.0:1788748383.713816:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713826:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713854:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.713887:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748383.713959:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:2347:x1875638358148736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 238us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.713967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00010000:00010000:2.0:1788748383.714011:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.714051:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748383.714075:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788748383.714289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c3cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.714323:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.714332:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748383.714336:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748383.714338:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9c00, rc 0) 00000100:00100000:2.0:1788748383.714371:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:10405:x1875638358148608:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8840us (9134us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788748383.714379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1788748383.719592:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.719703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358148992 00000100:00100000:1.0:1788748383.719717:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358148992 00000100:00100000:1.0:1788748383.719793:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1788748383.719806:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:10405:x1875638358148992:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:1.0:1788748383.720218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.720239:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.720253:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748383.720340:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788748383.720371:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004656be4c reply state 00000000ce597c98 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.720380:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748383.720494:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:10405:x1875638358148992:12345-192.168.203.4@tcp:36:bash.0 Request processed in 690us (914us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788748383.720502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000020:00080000:1.0:1788748383.720508:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748383.725213:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725234:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725242:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725249:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748383.725254:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725262:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725282:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:3.0:1788748383.725286:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748383.725292:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.725298:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c3e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748383.731274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748383.731369:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358149120 00000100:00100000:3.0:1788748383.731382:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358149120 00000100:00100000:3.0:1788748383.731460:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788748383.731481:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:10405:x1875638358149120:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748383.731512:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748383.731538:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c3e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216db expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.731658:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.731676:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.731686:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.731730:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.731747:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 46 pid: 5845 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748383.731764:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb767800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377051392:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748383.731996:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748383.734764:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748383.735782:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb767800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377051392:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748383.735825:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.738968:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358149248 00000100:00100000:1.0:1788748383.738990:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358149248 00010000:00010000:1.0:1788748383.739074:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 47 pid: 5845 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748383.739192:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1788748383.739205:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:2348:x1875638358149248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748383.739227:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748383.739234:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 47 pid: 5845 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739249:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 47 pid: 5845 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739277:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216d4 expref: 47 pid: 5845 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739298:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:1.0:1788748383.739321:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739332:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739341:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.739386:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748383.739583:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:2348:x1875638358149248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 380us (4833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748383.739593:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00010000:00010000:3.0:1788748383.739668:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.739678:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748383.739741:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788748383.739745:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748383.739771:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.739811:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c3e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216db expref: 46 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.739830:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216db expref: 45 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748383.739837:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:3.0:1788748383.739840:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748383.739843:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43c00, rc 0) 00000100:00100000:3.0:1788748383.739876:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:10405:x1875638358149120:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8408us (8618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.739885:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:1.0:1788748383.755298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.755382:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358149504 00000100:00100000:2.0:1788748383.755395:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358149504 00000100:00100000:2.0:1788748383.755457:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748383.755467:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:10405:x1875638358149504:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1788748383.755793:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:10405:x1875638358149504:12345-192.168.203.4@tcp:35:bash.0 Request processed in 326us (506us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788748383.755802:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748383.850726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748383.850930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358149760 00000100:00100000:1.0:1788748383.850944:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358149760 00000100:00100000:1.0:1788748383.851131:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:1.0:1788748383.851144:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:10415:x1875638358149760:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748383.851180:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748383.851205:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748383.851327:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788748383.851509:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216e2 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.851526:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:1.0:1788748383.851530:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748383.851537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216e2 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748383.851565:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9c00, rc 0) 00000100:00100000:1.0:1788748383.851646:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10415:x1875638358149760:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 505us (933us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788748383.851653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1788748383.857424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.858349:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358149888 00000100:00100000:2.0:1788748383.858366:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358149888 00000100:00100000:2.0:1788748383.858511:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1788748383.858525:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10415:x1875638358149888:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1788748383.858636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858659:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858689:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858709:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858716:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858722:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858836:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858846:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858853:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748383.858906:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858921:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858928:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858937:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858957:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.858962:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858971:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.858984:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748383.858988:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.858994:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859001:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859057:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859064:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859070:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859086:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.859090:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859096:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859115:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646e00) 00010000:00010000:2.0:1788748383.859118:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.859121:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c40b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859146:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859153:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859159:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859165:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.859168:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859174:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859182:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748383.859185:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.859188:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.859194:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748383.859298:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10415:x1875638358149888:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 775us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.859307:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1788748383.861562:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748383.861776:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358150144 00000100:00100000:0.0:1788748383.861789:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358150144 00000100:00100000:0.0:1788748383.861859:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788748383.861872:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10415:x1875638358150144:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748383.862223:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10415:x1875638358150144:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 352us (680us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788748383.862231:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788748383.921672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748383.921841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358150400 00000100:00100000:2.0:1788748383.921855:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358150400 00000100:00100000:2.0:1788748383.921937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1788748383.921950:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10418:x1875638358150400:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748383.921983:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748383.922011:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216e9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922190:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922210:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922225:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922243:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922251:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922259:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922421:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c42e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922431:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922439:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748383.922452:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788748383.922650:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922658:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922666:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922672:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.922677:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922686:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922699:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748383.922702:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.922708:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922725:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922743:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922749:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922755:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922761:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.922765:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922772:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922780:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646e00) 00010000:00010000:2.0:1788748383.922783:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748383.922786:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922793:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922847:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216e9 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922863:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c42e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216e9 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.922878:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748383.922881:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748383.922884:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:2.0:1788748383.923133:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10418:x1875638358150400:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1184us (1474us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788748383.923141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1788748383.927143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748383.927205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748383.927354:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358150656 00000100:00100000:0.0:1788748383.927369:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358150656 00000100:00100000:0.0:1788748383.927455:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1788748383.927486:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:2348:x1875638358150656:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748383.927527:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748383.927573:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c42e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216e9 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748383.927599:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:0.0:1788748383.927606:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748383.927680:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:2348:x1875638358150656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 197us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.927689:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748383.928243:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358150528 00000100:00100000:2.0:1788748383.928251:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358150528 00000100:00100000:2.0:1788748383.928292:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1788748383.928300:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:10418:x1875638358150528:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788748383.928377:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928395:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928410:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928446:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928454:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928461:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928468:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748383.928482:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928492:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928517:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748383.928521:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748383.928526:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748383.928533:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c43c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748383.928774:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:10418:x1875638358150528:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 474us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.928783:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788748383.930983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748383.931057:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358150912 00000100:00100000:0.0:1788748383.931068:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358150912 00000100:00100000:0.0:1788748383.931177:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788748383.931190:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:10418:x1875638358150912:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748383.931533:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10418:x1875638358150912:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 344us (557us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788748383.931542:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000004:00080000:2.0:1788748383.981864:0:8050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301024846113ns, next at 302024843118ns, rc = 0 00000100:00100000:0.0:1788748383.981903:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377051520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748383.982255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748383.982355:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377051520 00000100:00100000:1.0:1788748383.982366:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377051520 00000100:00100000:1.0:1788748383.982426:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788748383.982436:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377051520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748383.982481:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748383.982546:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377051520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748383.982554:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748383.982655:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377051520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748384.055154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.055333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358151168 00000100:00100000:2.0:1788748384.055347:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358151168 00000100:00100000:2.0:1788748384.055499:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788748384.055511:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10436:x1875638358151168:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:2.0:1788748384.055547:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748384.055584:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216f0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.055982:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c44a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.056002:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c44a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.056146:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c44a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748384.056162:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788748384.056340:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f0 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.056365:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c44a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f0 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.056373:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:2.0:1788748384.056377:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748384.056446:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2c00, rc 0) 00000100:00100000:2.0:1788748384.056595:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10436:x1875638358151168:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1085us (1453us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788748384.056602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788748384.075351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.075755:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358151296 00000100:00100000:3.0:1788748384.075788:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358151296 00000100:00100000:3.0:1788748384.075930:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788748384.075944:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10437:x1875638358151296:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748384.075975:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748384.076001:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216f7 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076156:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076189:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076202:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748384.076250:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788748384.076254:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748384.076276:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076310:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f7 expref: 54 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076332:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f7 expref: 53 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.076342:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748384.076345:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748384.076349:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42e00, rc 0) 00000100:00100000:3.0:1788748384.076429:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10437:x1875638358151296:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 488us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.076437:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788748384.081709:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.081941:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358151680 00000100:00100000:1.0:1788748384.081955:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358151680 00000100:00100000:1.0:1788748384.082059:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788748384.082072:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10437:x1875638358151680:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748384.082753:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10437:x1875638358151680:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 680us (1056us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788748384.082763:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788748384.085800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.085897:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358151808 00000100:00100000:0.0:1788748384.085911:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358151808 00000100:00100000:0.0:1788748384.085992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748384.086004:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10437:x1875638358151808:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1788748384.086055:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788748384.086122:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c3ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216db expref: 54 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.086146:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c44a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f0 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.086160:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c2fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652169c expref: 52 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.086171:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefe00) 00010000:00010000:0.0:1788748384.086185:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748384.086258:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10437:x1875638358151808:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 256us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.086266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748384.088905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.089059:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358151936 00000100:00100000:1.0:1788748384.089072:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358151936 00000100:00100000:1.0:1788748384.089143:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1788748384.089156:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10437:x1875638358151936:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:1.0:1788748384.089343:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.089363:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.089376:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748384.089759:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748384.089994:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788748384.090120:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788748384.090279:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10437:x1875638358151936:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 1121us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.090290:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1788748384.113963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.114104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152064 00000100:00100000:0.0:1788748384.114118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152064 00000100:00100000:0.0:1788748384.114198:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1788748384.114210:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10439:x1875638358152064:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748384.114239:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748384.114266:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c46d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265216fe expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114355:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114372:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114422:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114430:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114437:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114570:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114580:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114588:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748384.114633:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788748384.114639:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748384.114663:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114676:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114686:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114692:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114710:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114716:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.114721:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114729:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114743:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748384.114746:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.114751:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114758:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114773:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114780:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114785:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114790:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.114793:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114809:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114817:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec3e09b00) 00010000:00010000:0.0:1788748384.114819:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.114822:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114828:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c47b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114864:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c46d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114884:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.114891:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:0.0:1788748384.114893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748384.114896:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748384.115129:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10439:x1875638358152064:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 921us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.115137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000040:00080000:1.0:1788748384.173360:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748384.173374:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748384.173443:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788748384.173452:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748384.173637:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377051648:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748384.173783:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748384.180787:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377051648:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748384.186632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.186761:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152192 00000100:00100000:0.0:1788748384.186774:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152192 00000100:00100000:0.0:1788748384.186845:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748384.186857:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152192:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788748384.186994:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152192:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.187003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748384.190314:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.190434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152320 00000100:00100000:1.0:1788748384.190447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152320 00000100:00100000:1.0:1788748384.190531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1788748384.190543:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152320:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748384.190598:0:5846:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748384.190790:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152320:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 248us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.190816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1788748384.201184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.201702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152448 00000100:00100000:0.0:1788748384.201716:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152448 00000100:00100000:0.0:1788748384.201795:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788748384.201807:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152448:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788748384.202069:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202099:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202113:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202131:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202137:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202144:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202283:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202294:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202321:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748384.202375:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788748384.202381:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748384.202395:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202408:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202415:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202428:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.202433:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202441:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202455:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:0.0:1788748384.202458:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.202464:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202530:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c489 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202625:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202633:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202638:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202643:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.202646:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202653:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202662:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99cec3e09b00) 00010000:00010000:0.0:1788748384.202665:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.202668:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202674:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c490 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202690:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202696:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202702:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202716:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.202720:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202726:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:0.0:1788748384.202737:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.202740:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.202746:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.202975:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152448:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 1167us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.202984:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788748384.210150:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.210357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152704 00000100:00100000:2.0:1788748384.210372:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152704 00000100:00100000:2.0:1788748384.210447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788748384.210459:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10450:x1875638358152704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748384.210495:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748384.210522:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c49e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521705 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.210694:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.210712:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.210726:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748384.210742:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788748384.211156:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211166:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211173:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211179:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748384.211183:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211191:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211205:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:2.0:1788748384.211208:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748384.211214:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211233:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211287:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c49e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521705 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211298:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:2.0:1788748384.211300:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748384.211304:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c49e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521705 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.211314:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2a00, rc 0) 00000100:00100000:2.0:1788748384.211432:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358152704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 974us (1295us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788748384.211440:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:0.0:1788748384.223737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.227660:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358152832 00000100:00100000:1.0:1788748384.227683:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358152832 00000100:00100000:1.0:1788748384.227830:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:1.0:1788748384.227845:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358152832:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748384.227904:0:8052:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748384.228093:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358152832:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 250us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.228101:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1788748384.237851:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.237969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153088 00000100:00100000:1.0:1788748384.237983:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153088 00000100:00100000:1.0:1788748384.238110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1788748384.238124:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358153088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748384.238153:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748384.238157:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788748384.238201:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c45f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216f7 expref: 53 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.238225:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748384.238230:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748384.238247:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7c4b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652170c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748384.238985:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788748384.239307:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c4ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.239336:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.239350:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.239426:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7c4b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652170c expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.239448:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c4ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652170c expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.239457:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748384.239459:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748384.239463:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748384.240354:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10450:x1875638358153088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1427us (1713us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788748384.240368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1788748384.244456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.244646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153344 00000100:00100000:2.0:1788748384.244659:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153344 00000100:00100000:2.0:1788748384.244735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1788748384.244747:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10450:x1875638358153344:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748384.244822:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748384.244857:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c4ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652170c expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.244991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:2.0:1788748384.245008:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748384.245092:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245117:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245129:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245148:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245155:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245170:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245253:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245261:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245268:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245275:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748384.245279:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245288:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245297:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748384.245306:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748384.245312:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245318:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c4c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245331:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245336:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245342:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245347:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748384.245349:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245355:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245362:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x40358b29 (ffff99cec6646e00) 00010000:00010000:2.0:1788748384.245365:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748384.245368:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.245373:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x40358b29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.245484:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358153344:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 739us (1041us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748384.245502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:0.0:1788748384.248738:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.248837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153472 00000100:00100000:2.0:1788748384.248850:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153472 00000100:00100000:2.0:1788748384.249043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1788748384.249056:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10450:x1875638358153472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748384.249093:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748384.249122:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c4d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521713 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249165:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249181:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249195:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249314:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7c4d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249335:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.249344:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:2.0:1788748384.249347:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748384.249351:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2c00, rc 0) 00000100:00100000:2.0:1788748384.249421:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10450:x1875638358153472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 368us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748384.249435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:0.0:1788748384.252906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.253034:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153728 00000100:00100000:3.0:1788748384.253048:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153728 00000100:00100000:3.0:1788748384.253133:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:3.0:1788748384.253145:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10450:x1875638358153728:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748384.253283:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.253306:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.253321:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748384.253819:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788748384.253833:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301296817111ns, next at 302296813372ns, rc = 0 00000004:00010000:3.0:1788748384.253945:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001c1518a3 reply state 000000003251fe36 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.253957:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748384.254120:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10450:x1875638358153728:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 974us (1227us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788748384.254129:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00010000:00010000:0.0:1788748384.256581:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256603:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256624:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256630:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.256635:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256644:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256662:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:0.0:1788748384.256666:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748384.256671:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.256677:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c4e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.257811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.257895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153856 00000100:00100000:2.0:1788748384.257908:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153856 00000100:00100000:2.0:1788748384.257978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1788748384.257990:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10450:x1875638358153856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748384.258083:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748384.258107:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652171a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.258186:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.258203:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.258227:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:2.0:1788748384.258232:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748384.258236:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3600, rc 0) 00000100:00100000:2.0:1788748384.258304:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10450:x1875638358153856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 315us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748384.258311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:0.0:1788748384.261493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.261583:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358153984 00000100:00100000:3.0:1788748384.261605:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358153984 00000100:00100000:3.0:1788748384.261661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1788748384.261672:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875638358153984:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788748384.261711:0:6696:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1788748384.261750:0:6696:0:(genops.c:1384:class_connect()) connect: client 7b6e58be-3dc9-4518-a85f-e723d86d70a3, cookie 0x5b377f42a7a7c4f2 00002000:00100000:3.0:1788748384.261765:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b6e58be-3dc9-4518-a85f-e723d86d70a3/ffff99cee516e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748384.261796:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748384.262143:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788748384.262184:0:6696:0:(import.c:65:import_set_state_nolock()) ffff99cee516f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748384.262272:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2346:x1875638358153984:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 Request processed in 599us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.262280:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788748384.265060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.265247:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358154112 00000100:00100000:3.0:1788748384.265260:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358154112 00000100:00100000:3.0:1788748384.265350:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788748384.265362:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:0:x1875638358154112:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788748384.265827:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788748384.321626:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788748384.321644:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000100:00100000:3.0:1788748384.321847:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:0:x1875638358154112:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 56478us (56792us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788748384.321872:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1788748384.325230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.325299:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358154368 00000100:00100000:1.0:1788748384.325316:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358154368 00000100:00100000:1.0:1788748384.325399:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788748384.325413:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10450:x1875638358154368:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748384.325728:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10450:x1875638358154368:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 317us (504us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788748384.325752:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788748384.329506:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.329672:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358154624 00000100:00100000:0.0:1788748384.329682:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358154624 00000100:00100000:0.0:1788748384.329753:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1788748384.329762:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10450:x1875638358154624:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748384.329871:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10450:x1875638358154624:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.329879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1788748384.332969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.334630:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358154752 00000100:00100000:1.0:1788748384.334645:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358154752 00000100:00100000:1.0:1788748384.334842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1788748384.334856:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10450:x1875638358154752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748384.334878:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748384.334899:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7c4f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521721 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.334989:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.335005:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.335047:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748384.335098:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748384.335119:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.335147:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7c4f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521721 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.335166:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521721 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.335244:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:1.0:1788748384.335247:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788748384.335250:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8a00, rc 0) 00000100:00100000:1.0:1788748384.335309:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10450:x1875638358154752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 457us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.335317:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788748384.340754:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.342116:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358154880 00000100:00100000:3.0:1788748384.342134:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358154880 00000100:00100000:3.0:1788748384.342263:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788748384.342275:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358154880:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748384.342301:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748384.342339:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521728 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748384.342387:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e225f, blocks: 0x1 00010000:00010000:3.0:1788748384.342414:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788748384.342420:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748384.342430:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.342455:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.342469:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42400, rc 0) 00000100:00100000:3.0:1788748384.342822:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358154880:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 548us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.342831:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1788748384.346468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.346706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155136 00000100:00100000:3.0:1788748384.346720:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155136 00000100:00100000:3.0:1788748384.346788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1788748384.346798:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10450:x1875638358155136:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748384.346941:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10450:x1875638358155136:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.346949:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:0.0:1788748384.352775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.353052:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155264 00000100:00100000:1.0:1788748384.353063:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155264 00000100:00100000:1.0:1788748384.353134:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748384.353146:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:10450:x1875638358155264:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748384.353166:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748384.353198:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652172f expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.353229:0:8053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.353239:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748384.353245:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748384.353252:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.353289:0:8053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.353323:0:8053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748384.353339:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8053:1875638377051776:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748384.353426:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748384.364828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.364972:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8053:1875638377051776:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748384.365105:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.365131:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9000, rc 0) 00000100:00100000:1.0:1788748384.365247:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:10450:x1875638358155264:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 12103us (12479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.365267:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788748384.365431:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155392 00000100:00100000:0.0:1788748384.365441:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155392 00010000:00010000:0.0:1788748384.365496:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.365534:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788748384.365555:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5229050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358155392:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748384.365574:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748384.365760:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.365775:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.365804:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094d955f4/0x5b377f42a7a7c507 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521728 expref: 7 pid: 6696 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.365821:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748384.365826:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748384.365835:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 6 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.365846:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 6 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.365912:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 6 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.365929:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875638377051904:192.168.203.4@tcp:105: 00000100:00100000:0.0:1788748384.366002:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd3d8480 going to sleep for 11 seconds 00010000:00010000:1.0:1788748384.366154:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748384.370385:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875638377051904:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748384.370421:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748384.370596:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5229050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358155392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5050us (5781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.370610:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788748384.384343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.386620:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155520 00000100:00100000:3.0:1788748384.386653:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155520 00002000:00100000:3.0:1788748384.386728:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99cec2c16300 x1875638358155520/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:130/0 lens 504/0 e 0 to 0 dl 1788748395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748384.386858:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cec2c16300 with x1875638358155520 ext(0->8) 00002000:00010000:3.0:1788748384.386865:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cec2c16300 00000100:00100000:3.0:1788748384.386910:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788748384.386922:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358155520:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788748384.391604:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358155520:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 4671us (7260us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788748384.391623:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:3.0:1788748384.395223:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99cec2c16300 x1875638358155520/t4294967302(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:130/0 lens 504/448 e 0 to 0 dl 1788748395 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748384.395245:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cec2c16300 with x1875638358155520 ext(0->8) 00002000:00010000:3.0:1788748384.395255:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cec2c16300 00000100:00100000:2.0:1788748384.399357:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.399504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155648 00000100:00100000:1.0:1788748384.399518:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155648 00000100:00100000:1.0:1788748384.399589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1788748384.399603:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10450:x1875638358155648:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788748384.485340:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10450:x1875638358155648:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 85724us (85981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.485832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000001:00080000:1.0:1788748384.485943:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:1.0:1788748384.485963:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788748384.486065:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cefd74d780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788748384.486081:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cef7462d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cefd74d000 00000020:00080000:1.0:1788748384.486085:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cef7462a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ceff42bc00 00000001:00080000:1.0:1788748384.486152:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788748384.486213:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788748384.486255:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788748384.486439:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788748384.486802:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1788748384.486925:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1788748384.487329:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377052160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788748384.487481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748384.487644:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377052032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788748384.487671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748384.487824:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377052160 00000100:00100000:2.0:1788748384.487834:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377052160 00000100:00100000:2.0:1788748384.487891:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377052032 00000100:00100000:2.0:1788748384.487895:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377052032 00000100:00100000:2.0:1788748384.487937:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748384.487948:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377052160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788748384.488193:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788748384.488197:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788748383 00002000:00010000:2.0:1788748384.488200:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788748384.488202:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788748383 -> 1788748383 00002000:00010000:2.0:1788748384.488205:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788748384.488256:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377052160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (775us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788748384.488263:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748384.488285:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788748384.488293:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377052032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788748384.488311:0:6695:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788748384.488346:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e225d, atime: 0x6a9e225d, ctime: 0x6a9e225d, blocks: 0x1 00010000:00010000:2.0:1788748384.488435:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.488455:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788748384.488459:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748384.488467:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.488486:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.488514:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.488523:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.488619:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788748384.489309:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875638377052032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1012us (1632us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788748384.489319:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788748384.489655:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788748384.489714:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cefb764000/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788748384.489722:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377052160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788748384.489736:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ceecddd500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788748384.489740:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377052032:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788748384.489834:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748384.489844:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.489857:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748384.489862:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.489890:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.489913:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.489920:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7c515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.489946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748384.489948:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748384.489950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748384.491595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.491735:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358155776 00000100:00100000:2.0:1788748384.491748:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358155776 00000100:00100000:2.0:1788748384.491814:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788748384.491824:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358155776:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788748384.493157:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748384.493180:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377052288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748384.493249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748384.493461:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377052288 00000100:00100000:1.0:1788748384.493469:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377052288 00000100:00100000:1.0:1788748384.493524:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788748384.493532:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377052288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748384.493556:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748384.493608:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377052288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.493615:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788748384.493661:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377052288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748384.567613:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358155776:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 75780us (76018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748384.567626:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000001:00080000:1.0:1788748384.567940:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788748384.567965:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788748384.574134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.577548:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156032 00000100:00100000:3.0:1788748384.577660:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156032 00000100:00100000:3.0:1788748384.577881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1788748384.577899:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10450:x1875638358156032:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748384.577976:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748384.578045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521721 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.578081:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:3.0:1788748384.578088:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748384.578132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.578150:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.578171:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748384.579932:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a4955c81 reply state 00000000136fc230 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.580010:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748384.580308:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10450:x1875638358156032:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2405us (6171us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788748384.580324:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00010000:00010000:1.0:1788748384.585567:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585601:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585609:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585617:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748384.585623:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585632:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585652:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:1.0:1788748384.585656:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748384.585662:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.585668:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c51c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.589484:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.589848:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156160 00000100:00100000:1.0:1788748384.589865:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156160 00000100:00100000:1.0:1788748384.589941:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788748384.589954:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358156160:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788748384.590337:0:8053:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788748384.590342:0:8053:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788748383 -> 1788748383 00002000:00010000:1.0:1788748384.590345:0:8053:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788748381 00002000:00010000:1.0:1788748384.590348:0:8053:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788748383 -> 1788748383 00002000:00010000:1.0:1788748384.590356:0:8053:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788748384.590436:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358156160:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 485us (960us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788748384.590445:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1788748384.597610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.599099:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156416 00000100:00100000:3.0:1788748384.599116:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156416 00000100:00100000:3.0:1788748384.599192:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:3.0:1788748384.599204:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10450:x1875638358156416:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788748384.599304:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.599337:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.599347:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.599392:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.599409:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 13 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.599426:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377052416:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748384.599555:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1ba4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788748384.601493:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377052416:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748384.601527:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.606008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748384.607585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156544 00000100:00100000:0.0:1788748384.607605:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156544 00010000:00010000:0.0:1788748384.607667:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 14 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.607717:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788748384.607732:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2348:x1875638358156544:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748384.607763:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748384.607791:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 14 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607808:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 14 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607838:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c4dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521713 expref: 14 pid: 5846 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607855:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:0.0:1788748384.607861:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607871:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607880:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.607920:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748384.607996:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2348:x1875638358156544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 269us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.608005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00010000:00010000:3.0:1788748384.608273:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608676:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608717:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608726:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608734:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608740:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748384.608755:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608765:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608777:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:3.0:1788748384.608780:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788748384.608785:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.608791:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c523 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.608873:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:10450:x1875638358156416:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 9670us (11277us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788748384.608883:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788748384.611440:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748384.612368:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156672 00000100:00100000:1.0:1788748384.612385:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156672 00000100:00100000:1.0:1788748384.612458:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1788748384.612468:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358156672:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748384.612507:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.612527:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.612536:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748384.612588:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748384.612594:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.612632:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.612647:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748384.612661:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875638377052544:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748384.612758:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef73490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748384.623152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748384.623612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358156800 00000100:00100000:3.0:1788748384.623625:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358156800 00010000:00010000:3.0:1788748384.623679:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 8 pid: 8053 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.623730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788748384.623750:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358156800:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748384.623770:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748384.623799:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 8 pid: 8053 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.623815:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 8 pid: 8053 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.623848:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748384.623854:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748384.623861:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.623872:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.623921:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748384.623991:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358156800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 251us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.623999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00010000:00010000:2.0:1788748384.631482:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16f8c65/0x5b377f42a7a7c50e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652172f expref: 7 pid: 8053 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.631532:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875638377052544:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748384.631571:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631586:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631596:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631643:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631653:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631663:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631673:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748384.631679:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631689:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631723:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.631733:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070076a5e/0x5b377f42a7a7c52a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.631863:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358156672:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 19393us (20434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748384.631875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:3.0:1788748384.639676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.639777:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157056 00000100:00100000:2.0:1788748384.639790:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157056 00000100:00100000:2.0:1788748384.639865:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:2.0:1788748384.639878:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:10450:x1875638358157056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748384.639982:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640004:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640044:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640485:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640510:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640556:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.640573:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 13 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.640590:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377052672:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748384.640695:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748384.644067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.644529:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377052672:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748384.644576:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.644667:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157184 00000100:00100000:3.0:1788748384.644685:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157184 00010000:00010000:3.0:1788748384.644734:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 14 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.644789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1788748384.644799:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2347:x1875638358157184:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748384.644814:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748384.644822:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 14 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644840:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 14 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644863:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c4eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652171a expref: 14 pid: 5844 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644880:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:3.0:1788748384.644886:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644913:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644920:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.644954:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748384.644979:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.644991:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748384.645044:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358157184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 244us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.645057:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000001:00080000:2.0:1788748384.646985:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788748384.650873:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788748384.650972:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788748384.651284:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875638377052800:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788748384.651632:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748384.651733:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748384.651845:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377052800 00000100:00100000:1.0:1788748384.651855:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377052800 00000100:00100000:1.0:1788748384.651957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748384.651970:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875638377052800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788748384.652195:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875638377052800:12345-0@lo:1000:mdt00_001.0 Request processed in 227us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748384.652204:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748384.652296:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788748384.652314:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cefb764000, transno 4294967303 00000100:00100000:2.0:1788748384.652334:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875638377052800:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788748384.653665:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788748384.653824:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875638377052928:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788748384.653910:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748384.653952:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748384.654189:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377052928 00000100:00100000:0.0:1788748384.654198:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377052928 00000100:00100000:0.0:1788748384.654246:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748384.654256:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875638377052928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788748384.654726:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875638377052928:12345-0@lo:1000:mdt00_001.0 Request processed in 469us (813us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788748384.654735:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748384.654931:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875638377052928:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788748384.654978:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.654991:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655001:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655010:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748384.655200:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655211:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655229:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec6646500) 00010000:00010000:2.0:1788748384.655232:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748384.655238:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655245:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c538 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655293:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655360:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655378:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655384:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748384.655387:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655393:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655403:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:2.0:1788748384.655406:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748384.655410:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.655416:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c466 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.655660:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.655680:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.655690:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.655732:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.655818:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 16 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.655833:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377053056:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748384.655970:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748384.659193:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377053056:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748384.659238:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.659373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.659448:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157312 00000100:00100000:2.0:1788748384.659457:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157312 00010000:00010000:2.0:1788748384.659505:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 17 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.659549:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788748384.659561:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:2348:x1875638358157312:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748384.659596:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748384.659605:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 17 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659619:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 17 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659722:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265216fe expref: 17 pid: 5845 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659743:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:2.0:1788748384.659757:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659769:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659777:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748384.659805:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748384.659821:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659829:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659851:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659858:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659865:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748384.659866:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:2348:x1875638358157312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 308us (496us total) trans 0 rc 0/0 00010000:00010000:0.0:1788748384.659874:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc21454f0) 00000100:00100000:2.0:1788748384.659875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00010000:00010000:0.0:1788748384.659879:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659886:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659895:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:0.0:1788748384.659898:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748384.659902:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c53f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659918:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659924:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659929:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659940:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748384.659944:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659950:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659959:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaefa00) 00010000:00010000:0.0:1788748384.659961:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748384.659964:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748384.659969:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748384.662032:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10450:x1875638358157056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 22123us (22338us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788748384.662049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000020:00080000:0.0:1788748384.662056:0:5845:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788748384.662858:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748384.662866:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748384.662898:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788748384.662905:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748384.681601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748384.681723:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157568 00000100:00100000:2.0:1788748384.681733:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157568 00000100:00100000:2.0:1788748384.681789:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748384.681800:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10450:x1875638358157568:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788748384.682804:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788748384.682919:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788748384.682979:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.682994:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.683007:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.683128:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.683137:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.683143:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748384.683178:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748384.683209:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748384.683224:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.683237:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748384.683242:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.683253:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.683273:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cec9769600) 00010000:00010000:1.0:1788748384.683277:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788748384.683283:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.683290:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748384.683327:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748384.683329:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748384.683331:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748384.683469:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:10450:x1875638358157568:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1667us (1873us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788748384.683483:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000020:00080000:3.0:1788748384.683490:0:5848:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1788748384.947471:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788748384.947483:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748384.947525:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788748384.947532:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748385.051654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.051738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157824 00000100:00100000:3.0:1788748385.051752:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157824 00000100:00100000:3.0:1788748385.051840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788748385.051854:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:10460:x1875638358157824:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748385.051885:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.051911:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c54d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521736 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.052083:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c554 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.052100:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.052117:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748385.052130:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788748385.052667:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c54d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521736 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.052702:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521736 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.052713:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.052717:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788748385.052721:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43a00, rc 0) 00000100:00100000:3.0:1788748385.052804:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:10460:x1875638358157824:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 953us (1359us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788748385.052812:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00080000:1.0:1788748385.053114:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748385.057747:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.058635:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358157952 00000100:00100000:1.0:1788748385.058650:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358157952 00000100:00100000:1.0:1788748385.058770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:1.0:1788748385.058783:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:10460:x1875638358157952:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1788748385.058881:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.058903:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.058918:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.058945:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.058953:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.058960:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059718:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059741:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059750:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748385.059801:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059815:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059822:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059830:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059837:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748385.059842:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059850:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059863:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748385.059866:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748385.059873:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059879:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059901:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059907:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059912:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059918:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748385.059921:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.059991:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060000:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cecfaefe00) 00010000:00010000:1.0:1788748385.060003:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748385.060006:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060042:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060748:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060760:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060767:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060784:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748385.060787:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060794:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060805:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748385.060808:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748385.060812:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.060818:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.061759:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:10460:x1875638358157952:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 2968us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.061776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:3.0:1788748385.122105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.122321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358158208 00000100:00100000:0.0:1788748385.122334:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358158208 00000100:00100000:0.0:1788748385.122407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1788748385.122419:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:10463:x1875638358158208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748385.122457:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748385.122491:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652173d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122595:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122624:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122639:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122657:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122665:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122672:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.122989:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123000:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123008:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748385.123050:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788748385.123628:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123638:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123646:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123662:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748385.123667:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123676:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123691:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748385.123695:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748385.123701:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123707:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c57e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123722:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123728:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123734:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123740:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748385.123743:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123749:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123767:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec3e09e00) 00010000:00010000:0.0:1788748385.123769:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748385.123772:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123779:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123832:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123847:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.123856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.123859:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748385.123861:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748385.123942:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10463:x1875638358158208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1524us (1851us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788748385.123950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:1.0:1788748385.139739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.142987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358158336 00000100:00100000:2.0:1788748385.143007:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358158336 00000100:00100000:3.0:1788748385.143442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:3.0:1788748385.143664:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10463:x1875638358158336:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788748385.143760:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143780:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143795:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143828:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143836:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143862:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143868:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.143874:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143881:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143893:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:3.0:1788748385.143897:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748385.143903:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.143908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c59a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.144257:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10463:x1875638358158336:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 793us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.144267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:3.0:1788748385.148492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.148924:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358158592 00000100:00100000:1.0:1788748385.148938:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358158592 00000100:00100000:1.0:1788748385.149005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748385.149038:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10463:x1875638358158592:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748385.149517:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:10463:x1875638358158592:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 501us (1051us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788748385.149526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748385.185995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.190755:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358158848 00000100:00100000:3.0:1788748385.190778:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358158848 00000100:00100000:3.0:1788748385.194730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1788748385.194759:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:9992:x1875638358158848:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748385.194795:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.194820:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521744 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.194981:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.194999:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.195008:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.195096:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.195113:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 23 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.195128:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb767800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377053184:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748385.195332:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1ba4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748385.211252:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb767800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377053184:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748385.211289:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.212902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.216384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358158976 00000100:00100000:0.0:1788748385.216407:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358158976 00010000:00010000:0.0:1788748385.216468:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 24 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.216532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1788748385.216544:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:2348:x1875638358158976:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.216563:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.216573:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 24 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216588:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 24 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216616:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c58c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652173d expref: 24 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216633:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.216639:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216650:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216658:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216690:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.216764:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:2348:x1875638358158976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 222us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.216772:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00010000:00010000:0.0:1788748385.216809:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.216823:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748385.216848:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788748385.217059:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.219390:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.219411:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.219415:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748385.219419:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42e00, rc 0) 00000100:00100000:0.0:1788748385.219551:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:9992:x1875638358158848:12345-192.168.203.4@tcp:101:bash.0 Request processed in 24793us (33559us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788748385.219562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1788748385.231962:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.232036:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358159232 00000100:00100000:2.0:1788748385.232049:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358159232 00000100:00100000:2.0:1788748385.232128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:2.0:1788748385.232283:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:9992:x1875638358159232:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1788748385.234335:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.234364:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.234377:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748385.235732:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788748385.235815:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000063d0b241 reply state 000000009dbe9e28 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.235829:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788748385.235947:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788748385.236128:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:9992:x1875638358159232:12345-192.168.203.4@tcp:36:bash.0 Request processed in 3986us (4176us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788748385.236138:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000020:00080000:2.0:1788748385.238326:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788748385.247372:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1788748385.247411:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247426:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247435:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247442:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748385.247458:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247672:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247693:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.247697:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748385.247702:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247708:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7c5b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.247753:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358159360 00000100:00100000:0.0:1788748385.247765:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358159360 00000100:00100000:0.0:1788748385.247827:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:0.0:1788748385.247837:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:9992:x1875638358159360:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748385.247867:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748385.247887:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c5bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652174b expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247958:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c5bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652174b expref: 27 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247972:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c5bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652174b expref: 27 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.247993:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.247996:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748385.247999:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748385.248117:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:9992:x1875638358159360:12345-192.168.203.4@tcp:101:bash.0 Request processed in 280us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.248125:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:1.0:1788748385.259964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.260174:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358159488 00000100:00100000:0.0:1788748385.260189:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358159488 00000100:00100000:0.0:1788748385.260297:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748385.260310:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:9992:x1875638358159488:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748385.260335:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748385.260364:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521752 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748385.260401:0:8053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e225f, atime: 0x6a9e225d, ctime: 0x6a9e225f, blocks: 0xb 00010000:00010000:0.0:1788748385.260431:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1788748385.260437:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748385.260458:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.260486:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.260502:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748385.261701:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:9992:x1875638358159488:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1383us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.261714:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1788748385.269961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.270218:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358159616 00000100:00100000:1.0:1788748385.270231:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358159616 00002000:00010000:1.0:1788748385.270287:0:6700:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788748385.270293:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefb767100 with x1875638358159616 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748385.270308:0:6700:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefb767100. 00000100:00100000:1.0:1788748385.270339:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788748385.270350:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358159616:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:1.0:1788748385.271101:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788748385.271108:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788748383 -> 1788748384 00002000:00010000:1.0:1788748385.271111:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788748381 -> 1788748381 00002000:00010000:1.0:1788748385.271113:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788748383 -> 1788748384 00002000:00010000:1.0:1788748385.271115:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788748385.271193:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358159616:12345-192.168.203.4@tcp:10:bash.0 Request processed in 842us (1243us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788748385.271203:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00010000:1.0:1788748385.271208:0:6700:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788748385.271211:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefb767100 with x1875638358159616 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748385.271217:0:6700:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefb767100. 00000100:00100000:2.0:1788748385.337253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.337347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358159744 00000100:00100000:3.0:1788748385.337360:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358159744 00000100:00100000:3.0:1788748385.337428:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1788748385.337440:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:10477:x1875638358159744:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788748385.337536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337598:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337617:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337624:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337631:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337909:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337925:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748385.337970:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337982:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337989:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.337996:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338059:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.338065:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338084:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338098:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.338101:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.338107:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42400/0x5b377f42a7a7c5cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338127:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338133:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338138:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338144:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.338147:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338152:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338168:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec9769100) 00010000:00010000:3.0:1788748385.338170:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.338173:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338180:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43c00/0x5b377f42a7a7c5d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338194:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338199:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338205:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338210:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.338213:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338218:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338224:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:3.0:1788748385.338226:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.338229:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.338234:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c5d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.338326:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:10477:x1875638358159744:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 887us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.338334:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:2.0:1788748385.370520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.370940:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358160000 00000100:00100000:0.0:1788748385.370955:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358160000 00000100:00100000:0.0:1788748385.371109:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1788748385.371121:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:10480:x1875638358160000:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748385.371149:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748385.371184:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c5e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521759 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371277:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371296:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371310:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371327:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371335:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.371342:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372128:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c5f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372155:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372175:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748385.372189:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788748385.372300:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372308:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372315:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372322:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.372326:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372335:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372349:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748385.372353:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748385.372358:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372365:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c5e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372379:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372391:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372397:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372401:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.372404:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372410:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372418:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec3e09b00) 00010000:00010000:2.0:1788748385.372421:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748385.372423:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372429:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c5ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372688:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c5e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521759 expref: 30 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372705:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521759 expref: 29 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.372713:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:2.0:1788748385.372715:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788748385.372725:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2a00, rc 0) 00000100:00100000:2.0:1788748385.372821:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10480:x1875638358160000:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1695us (2308us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788748385.372829:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1788748385.379957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.380317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358160128 00000100:00100000:3.0:1788748385.380330:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358160128 00000100:00100000:3.0:1788748385.380401:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:3.0:1788748385.380413:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10480:x1875638358160128:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788748385.380693:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.380714:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.380725:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.380767:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.380784:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 29 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.380800:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377053312:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748385.380948:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1ba4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748385.384382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.384448:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358160384 00000100:00100000:1.0:1788748385.384459:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358160384 00000100:00100000:1.0:1788748385.384533:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748385.384548:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:5588:x1875638358160384:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788748385.385122:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:5588:x1875638358160384:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 578us (751us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788748385.385132:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788748385.385809:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377053312:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748385.385840:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.388456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.388736:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358160512 00000100:00100000:0.0:1788748385.388748:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358160512 00010000:00010000:0.0:1788748385.388803:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 31 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.388904:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1788748385.388915:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:2347:x1875638358160512:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.388934:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.388941:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 31 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.388956:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 31 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.388982:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42e00/0x5b377f42a7a7c5a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521744 expref: 31 pid: 5844 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.388998:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:0.0:1788748385.389004:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.389279:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.389289:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.389323:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.389385:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:2347:x1875638358160512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 471us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.389392:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00010000:00010000:3.0:1788748385.389444:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389453:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389500:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389507:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389513:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389520:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.389524:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389532:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389548:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:3.0:1788748385.389551:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748385.389556:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.389561:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.389615:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10480:x1875638358160128:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 9204us (9672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.389633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:0.0:1788748385.392561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.392812:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358160768 00000100:00100000:3.0:1788748385.392824:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358160768 00000100:00100000:3.0:1788748385.392892:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1788748385.392904:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:10480:x1875638358160768:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748385.393359:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:10480:x1875638358160768:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 457us (820us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788748385.393368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00010000:00010000:1.0:1788748385.397344:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748385.471762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.472232:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358161024 00000100:00100000:2.0:1788748385.472246:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358161024 00000100:00100000:3.0:1788748385.472395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:3.0:1788748385.472408:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:10491:x1875638358161024:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1788748385.472440:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.472702:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c60a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521760 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472799:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472817:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472831:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472847:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.472876:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473708:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7c61f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473723:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7c61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473733:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7c61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748385.473748:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788748385.473874:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473883:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473891:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473897:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fc00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.473902:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473911:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473926:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.473930:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.473945:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473952:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7c611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473969:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473976:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473982:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473988:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fe00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.473992:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.473998:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.474006:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec9769100) 00010000:00010000:3.0:1788748385.474009:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.474217:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.474225:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.474291:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c60a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521760 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.474321:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7c61f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521760 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.474329:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:3.0:1788748385.474332:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748385.474334:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e800, rc 0) 00000100:00100000:3.0:1788748385.474431:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10491:x1875638358161024:12345-192.168.203.4@tcp:101:cat.0 Request processed in 2025us (2695us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788748385.474440:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1788748385.479914:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.480064:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358161280 00000100:00100000:1.0:1788748385.480086:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358161280 00000100:00100000:1.0:1788748385.480148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788748385.480158:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10491:x1875638358161280:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:1.0:1788748385.480447:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:10491:x1875638358161280:12345-192.168.203.4@tcp:35:cat.0 Request processed in 290us (547us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788748385.480455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788748385.499202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.499830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358161536 00000100:00100000:2.0:1788748385.499846:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358161536 00000100:00100000:2.0:1788748385.499928:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788748385.499939:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:10492:x1875638358161536:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:2.0:1788748385.500089:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788748385.500126:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7c61f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521760 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500152:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c5f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521759 expref: 32 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500232:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c5bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652174b expref: 31 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500245:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec3e09600) 00010000:00010000:2.0:1788748385.500258:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748385.500283:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500299:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500333:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500353:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500361:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.500367:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.501800:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.501821:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.501834:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748385.504823:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788748385.504843:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302547827415ns, next at 303547822437ns, rc = 0 00010000:00010000:3.0:1788748385.504953:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.504973:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.504986:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505055:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505064:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505079:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505112:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748385.505142:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505149:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505156:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505417:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.505423:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505431:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505446:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769100) 00010000:00010000:3.0:1788748385.505449:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788748385.505454:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505484:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c63b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505511:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505517:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505522:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505527:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.505530:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505823:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505833:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.505835:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.505839:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.505844:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c62d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748385.505858:0:5845:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000023db18ea reply state 0000000043113241 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.505867:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748385.506123:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:10492:x1875638358161536:12345-192.168.203.4@tcp:36:rm.0 Request processed in 6178us (6928us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788748385.506134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00010000:00010000:1.0:1788748385.506319:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748385.506328:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.506335:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fe00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748385.506338:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.506344:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.506355:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cec9769100) 00010000:00010000:1.0:1788748385.506358:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788748385.506361:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.506366:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fe00/0x5b377f42a7a7c642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.506386:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.506389:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.506390:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.518077:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518100:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518109:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518116:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748385.518122:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518131:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518154:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646500) 00010000:00010000:1.0:1788748385.518158:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748385.518164:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.518170:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c634 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.548625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.548751:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358161792 00000100:00100000:2.0:1788748385.548764:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358161792 00000100:00100000:2.0:1788748385.548839:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:2.0:1788748385.548851:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:10498:x1875638358161792:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748385.548883:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748385.548911:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521767 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549119:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549136:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549150:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549221:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549248:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.549255:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748385.550137:0:8052:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788748385.550914:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.550933:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.550944:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.550988:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.550996:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551002:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551009:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748385.551037:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551045:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551058:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748385.551061:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748385.551078:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551085:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748385.551116:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f498c1a1 reply state 000000001d5590f6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.551126:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788748385.551961:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 34 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551988:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 33 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.551997:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:0.0:1788748385.552000:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748385.552002:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4000, rc 0) 00000100:00100000:0.0:1788748385.552276:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:10498:x1875638358161792:12345-192.168.203.4@tcp:101:bash.0 Request processed in 3424us (3664us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788748385.552286:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:1.0:1788748385.555514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1788748385.555607:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555620:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555629:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555637:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.555642:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555651:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555671:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646000) 00010000:00010000:2.0:1788748385.555675:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748385.555681:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.555687:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.555768:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358161920 00000100:00100000:3.0:1788748385.555781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358161920 00000100:00100000:3.0:1788748385.555860:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788748385.555872:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358161920:12345-192.168.203.4@tcp:101:bash.0 00000100:00080000:1.0:1788748385.555881:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788748385.555896:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.555919:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652176e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748385.555951:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748385.555976:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1788748385.555981:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748385.555992:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.556034:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.556049:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e400, rc 0) 00000100:00100000:0.0:1788748385.556186:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358161920:12345-192.168.203.4@tcp:101:bash.0 Request processed in 314us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.556194:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:0.0:1788748385.560208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.560310:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358162048 00000100:00100000:3.0:1788748385.560324:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358162048 00000100:00100000:3.0:1788748385.560406:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1788748385.560418:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:10498:x1875638358162048:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748385.560442:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.560465:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521775 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.560524:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.560535:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748385.560540:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748385.560546:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.560588:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.560603:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 9 pid: 6695 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.560621:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875638377053440:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748385.560736:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1ba4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748385.565794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.565915:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358162176 00000100:00100000:0.0:1788748385.565928:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358162176 00010000:00010000:0.0:1788748385.565985:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 10 pid: 6695 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.566160:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1788748385.566175:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed420450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2347:x1875638358162176:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748385.566197:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748385.566249:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 10 pid: 6695 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.566266:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 10 pid: 6695 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.566300:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748385.566306:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748385.566317:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.566329:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.566559:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.566580:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377053568:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748385.566688:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349900 going to sleep for 11 seconds 00010000:00010000:3.0:1788748385.567743:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee81f841/0x5b377f42a7a7c66c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652176e expref: 10 pid: 6695 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.567768:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875638377053440:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748385.567803:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.567819:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fc00, rc 0) 00000100:00100000:3.0:1788748385.567900:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:10498:x1875638358162048:12345-192.168.203.4@tcp:101:bash.0 Request processed in 7483us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.567909:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788748385.572388:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377053568:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748385.572442:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.572715:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed420450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358162176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 6543us (6935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.572729:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:2.0:1788748385.576147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.577063:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358162432 00000100:00100000:1.0:1788748385.577089:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358162432 00000100:00100000:1.0:1788748385.577177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788748385.577189:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:10498:x1875638358162432:12345-192.168.203.4@tcp:35:bash.0 00000001:00080000:1.0:1788748385.577800:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:1.0:1788748385.577946:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10498:x1875638358162432:12345-192.168.203.4@tcp:35:bash.0 Request processed in 756us (1815us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788748385.577975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000020:00080000:1.0:1788748385.577982:0:5847:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788748385.702157:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.702265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358162560 00000100:00100000:3.0:1788748385.702278:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358162560 00000100:00100000:3.0:1788748385.702346:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:3.0:1788748385.702357:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:10514:x1875638358162560:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748385.702389:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.702414:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c67a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652177c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702499:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702515:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702529:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748385.702581:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788748385.702585:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748385.702604:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c67a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652177c expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702651:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652177c expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.702682:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.702686:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748385.702690:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e000, rc 0) 00000100:00100000:3.0:1788748385.702760:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:10514:x1875638358162560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 405us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.702767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1788748385.707454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.707676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358162816 00000100:00100000:3.0:1788748385.707688:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358162816 00000100:00100000:3.0:1788748385.707761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1788748385.707773:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:10514:x1875638358162816:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748385.707799:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.707826:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521783 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.707955:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7c68f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.707972:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7c68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.707986:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7c68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748385.707999:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788748385.708234:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521783 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.708266:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7c68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521783 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.708275:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:3.0:1788748385.708278:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748385.708282:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f600, rc 0) 00000100:00100000:3.0:1788748385.708360:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:10514:x1875638358162816:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 589us (922us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788748385.708368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:2.0:1788748385.712401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.712448:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.712632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163072 00000100:00100000:3.0:1788748385.712646:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163072 00000100:00100000:3.0:1788748385.712728:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:3.0:1788748385.712740:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:10514:x1875638358163072:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748385.712773:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748385.712799:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c69d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652178a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.712928:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.712945:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.712959:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748385.712974:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788748385.713224:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c69d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652178a expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.713245:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652178a expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.713253:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:3.0:1788748385.713256:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788748385.713259:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ea00, rc 0) 00000100:00100000:3.0:1788748385.713329:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:10514:x1875638358163072:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 591us (943us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788748385.713337:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:0.0:1788748385.713483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163200 00000100:00100000:0.0:1788748385.713489:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163200 00000100:00100000:0.0:1788748385.713546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788748385.713555:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:2347:x1875638358163200:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.713568:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.713586:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7c68f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521783 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.713598:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:0.0:1788748385.713602:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.713623:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:2347:x1875638358163200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 70us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.713630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748385.722584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.722712:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163328 00000100:00100000:0.0:1788748385.722724:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163328 00000100:00100000:0.0:1788748385.722793:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1788748385.722804:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358163328:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1788748385.722863:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.722886:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.722917:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748385.722923:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748385.722928:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.722975:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.722992:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 8 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.723010:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5295c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377053696:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748385.723160:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748385.726510:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.726661:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163456 00000100:00100000:3.0:1788748385.726674:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163456 00002000:00100000:3.0:1788748385.726743:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99cf01eeb100 x1875638358163456/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:131/0 lens 504/0 e 0 to 0 dl 1788748396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748385.726756:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cf01eeb100 with x1875638358163456 ext(0->8) 00010000:00010000:3.0:1788748385.726768:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 9 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.726787:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 9 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748385.726796:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cf01eeb100 00000100:00100000:3.0:1788748385.726842:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748385.726855:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358163456:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:3.0:1788748385.727511:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2348:x1875638358163456:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 655us (1011us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788748385.727526:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00100000:3.0:1788748385.727535:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99cf01eeb100 x1875638358163456/t4294967302(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:131/0 lens 504/448 e 0 to 0 dl 1788748396 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788748385.727922:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5295c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377053696:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748385.727954:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788748385.728666:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cf01eeb100 with x1875638358163456 ext(0->8) 00010000:00010000:3.0:1788748385.728678:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.728695:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748385.728704:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cf01eeb100 00000100:00100000:3.0:1788748385.730852:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.731050:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163584 00000100:00100000:0.0:1788748385.731062:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163584 00010000:00010000:0.0:1788748385.731122:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.731171:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1788748385.731183:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2348:x1875638358163584:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.731223:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788748385.731252:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788748385.731256:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788748385 00002000:00010000:0.0:1788748385.731258:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788748385 00002000:00010000:0.0:1788748385.731261:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788748385 00010000:00010000:0.0:1788748385.731269:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.731286:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.731316:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7c673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521775 expref: 11 pid: 6696 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.731338:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748385.731344:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748385.731351:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.731363:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.731407:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.731480:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358163584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 299us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.731488:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00010000:00010000:2.0:1788748385.731732:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731743:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731773:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731782:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731792:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731799:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748385.731804:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731813:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731839:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.731849:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7c6b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.731901:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358163328:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 9099us (9331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748385.731909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1788748385.734702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.734841:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163840 00000100:00100000:2.0:1788748385.734854:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163840 00000100:00100000:2.0:1788748385.734927:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1788748385.734938:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:10514:x1875638358163840:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:2.0:1788748385.735043:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652178a expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748385.735807:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788748385.735848:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788748385.737826:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1788748385.737931:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.737957:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.737967:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.738059:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.738089:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 43 pid: 8052 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.738107:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875638377053824:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748385.738240:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748385.740706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.740968:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358163968 00000100:00100000:0.0:1788748385.740981:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358163968 00010000:00010000:0.0:1788748385.741082:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 44 pid: 8052 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.741122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788748385.741133:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:2347:x1875638358163968:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.741150:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.741157:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 44 pid: 8052 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.741173:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 44 pid: 8052 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.741199:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:0.0:1788748385.741205:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.741215:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.741224:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.741247:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.741307:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:2347:x1875638358163968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.741315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00010000:00010000:2.0:1788748385.741547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c65e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521767 expref: 43 pid: 8052 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.741568:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875638377053824:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748385.741592:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.741601:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.741607:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748385.741769:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1788748385.742075:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788748385.742235:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875638377053952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788748385.742296:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748385.742340:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748385.742717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377053952 00000100:00100000:3.0:1788748385.742726:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377053952 00000100:00100000:3.0:1788748385.742783:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748385.742794:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875638377053952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788748385.742887:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875638377053952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.742894:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748385.743429:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875638377053952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788748385.744615:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788748385.744714:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875638377054080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788748385.744786:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748385.744825:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748385.745220:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377054080 00000100:00100000:3.0:1788748385.745229:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377054080 00000100:00100000:3.0:1788748385.745286:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748385.745296:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875638377054080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788748385.745817:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5847:x1875638377054080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 520us (1028us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788748385.745839:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748385.745866:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875638377054080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788748385.745950:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788748385.746003:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746049:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746060:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746076:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.746082:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746091:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746110:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:2.0:1788748385.746113:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788748385.746119:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.746126:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748385.746704:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788748385.746844:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788748385.746915:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302789899628ns, next at 303789839244ns, rc = 0 00000001:00080000:2.0:1788748385.746978:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788748385.747448:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:2.0:1788748385.747453:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788748385.747466:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7c6a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652178a expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.747628:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:10514:x1875638358163840:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 12691us (12939us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788748385.747638:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000020:00080000:2.0:1788748385.747644:0:5847:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788748385.751302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.751616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358164096 00000100:00100000:0.0:1788748385.751644:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358164096 00000100:00100000:0.0:1788748385.751721:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:0.0:1788748385.751732:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:10514:x1875638358164096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748385.751765:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748385.751794:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c6c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521791 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.752396:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c6c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521791 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.752417:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c6c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521791 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.752451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748385.752454:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748385.752459:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748385.752536:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10514:x1875638358164096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 805us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.752544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:3.0:1788748385.755944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748385.756091:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358164352 00000100:00100000:0.0:1788748385.756105:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358164352 00000100:00100000:0.0:1788748385.756212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788748385.756225:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:10514:x1875638358164352:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748385.756549:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10514:x1875638358164352:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 326us (618us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788748385.756557:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748385.844383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.844642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358164480 00000100:00100000:3.0:1788748385.844656:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358164480 00000100:00100000:3.0:1788748385.844731:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:3.0:1788748385.844743:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10524:x1875638358164480:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788748385.844846:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.844866:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.844881:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.844899:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.844906:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.844914:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845090:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845099:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845130:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748385.845375:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845391:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845398:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845407:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845413:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.845418:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845426:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845439:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748385.845443:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.845449:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845456:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c6c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845485:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845499:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845505:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845511:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ee00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.845514:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845520:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845529:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec9769600) 00010000:00010000:3.0:1788748385.845532:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.845535:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845842:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c6ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845861:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845866:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845872:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845877:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748385.845888:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845895:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845905:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:3.0:1788748385.845908:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748385.845911:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.845917:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c6d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.846156:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10524:x1875638358164480:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1411us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.846173:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:3.0:1788748385.899991:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748385.900967:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358164736 00000100:00100000:2.0:1788748385.900983:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358164736 00000100:00100000:2.0:1788748385.901240:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:2.0:1788748385.901598:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:10527:x1875638358164736:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748385.901626:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748385.901654:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521798 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901768:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901787:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901801:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901818:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901843:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.901851:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902043:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902053:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902060:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748385.902081:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788748385.902360:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902370:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902378:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902384:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.902390:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902398:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902426:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748385.902429:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748385.902436:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902443:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c6e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902460:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902466:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902473:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902479:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748385.902481:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902617:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902629:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646000) 00010000:00010000:2.0:1788748385.902631:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748385.902635:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902641:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c6ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902702:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7c6dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521798 expref: 51 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902716:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521798 expref: 50 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.902725:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748385.902727:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748385.902730:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3200, rc 0) 00000100:00100000:2.0:1788748385.902828:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10527:x1875638358164736:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1237us (2850us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788748385.902837:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:2.0:1788748385.910751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748385.910847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358164864 00000100:00100000:1.0:1788748385.910861:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358164864 00000100:00100000:1.0:1788748385.910935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:1.0:1788748385.910946:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10527:x1875638358164864:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1788748385.911366:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911391:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911407:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911443:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911450:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911458:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911464:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748385.911469:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911494:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748385.911511:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748385.911516:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.911522:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.911611:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10527:x1875638358164864:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 665us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.911618:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:1.0:1788748385.925637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748385.925767:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358165120 00000100:00100000:3.0:1788748385.925781:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358165120 00000100:00100000:3.0:1788748385.925859:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1788748385.925872:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:10527:x1875638358165120:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748385.926241:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10527:x1875638358165120:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 370us (781us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788748385.926375:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1788748386.029743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.029933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358165376 00000100:00100000:0.0:1788748386.029963:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358165376 00000100:00100000:0.0:1788748386.030072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:0.0:1788748386.030085:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10537:x1875638358165376:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748386.030120:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748386.030124:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788748386.030164:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e000/0x5b377f42a7a7c681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652177c expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748386.030195:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748386.030213:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c706 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652179f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030342:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c70d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030360:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030372:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748386.030385:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788748386.030846:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c706 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652179f expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030864:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652179f expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.030871:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.030883:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748386.030886:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4200, rc 0) 00000100:00100000:0.0:1788748386.030963:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10537:x1875638358165376:12345-192.168.203.4@tcp:101:bash.0 Request processed in 880us (1235us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788748386.030970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:2.0:1788748386.035847:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.036173:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358165504 00000100:00100000:0.0:1788748386.036188:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358165504 00000100:00100000:0.0:1788748386.036269:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748386.036282:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:2347:x1875638358165504:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748386.036301:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748386.036335:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c70d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652179f expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.036356:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.036362:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748386.036435:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:2347:x1875638358165504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 156us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.036443:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748386.039335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.039443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358165760 00000100:00100000:3.0:1788748386.039456:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358165760 00000100:00100000:3.0:1788748386.039559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:3.0:1788748386.039579:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:10537:x1875638358165760:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:3.0:1788748386.039688:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748386.039720:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c6f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521798 expref: 51 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.039754:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:3.0:1788748386.039760:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748386.040118:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.040135:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.040149:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748386.040211:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788748386.040239:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000022b2d80 reply state 00000000fb8972b3 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.040251:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748386.040377:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10537:x1875638358165760:12345-192.168.203.4@tcp:36:bash.0 Request processed in 808us (1057us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788748386.040387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000020:00080000:3.0:1788748386.040394:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788748386.044345:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044369:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044377:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044385:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ee00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748386.044390:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044400:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044450:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748386.044453:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748386.044460:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.044467:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7c71b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748386.050995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.052653:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358165888 00000100:00100000:2.0:1788748386.052675:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358165888 00000100:00100000:2.0:1788748386.053412:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:2.0:1788748386.053431:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:10537:x1875638358165888:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748386.053467:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748386.053497:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217a6 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053613:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053634:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053673:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748386.053713:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788748386.053717:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748386.053742:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053774:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 54 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053798:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 53 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.053808:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748386.053812:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748386.053817:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3000, rc 0) 00000100:00100000:2.0:1788748386.053914:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10537:x1875638358165888:12345-192.168.203.4@tcp:101:bash.0 Request processed in 490us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.053921:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:3.0:1788748386.057356:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.057460:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166144 00000100:00100000:1.0:1788748386.057474:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166144 00000100:00100000:1.0:1788748386.057719:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788748386.057734:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:10537:x1875638358166144:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788748386.058112:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10537:x1875638358166144:12345-192.168.203.4@tcp:35:bash.0 Request processed in 381us (781us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788748386.058121:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1788748386.159980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.160232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166272 00000100:00100000:1.0:1788748386.160245:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166272 00000100:00100000:1.0:1788748386.160324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:1.0:1788748386.160337:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:10543:x1875638358166272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748386.160371:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.160398:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217ad expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160507:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160524:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160569:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748386.160619:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788748386.160623:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748386.160645:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160673:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ad expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160696:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ad expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.160706:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748386.160709:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748386.160715:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9a00, rc 0) 00000100:00100000:1.0:1788748386.160817:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358166272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 483us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.160825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:3.0:1788748386.166302:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.169908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166400 00000100:00100000:0.0:1788748386.169930:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166400 00000100:00100000:0.0:1788748386.170115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:0.0:1788748386.170130:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358166400:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748386.170159:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748386.170188:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c73e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217b4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170282:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170319:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170335:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170353:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170361:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.170368:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172364:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172392:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172407:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748386.172739:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788748386.172745:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748386.172775:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172792:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172829:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172836:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172844:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172851:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748386.172856:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172864:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172880:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:0.0:1788748386.172884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748386.172890:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172897:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172915:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172922:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172928:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172940:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748386.172944:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172950:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172958:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec3e09a00) 00010000:00010000:0.0:1788748386.172961:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748386.172964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.172970:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c74c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.173474:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c73e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.173496:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.173506:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.173509:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748386.173511:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748386.173694:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10543:x1875638358166400:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 3491us (7331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.173705:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:2.0:1788748386.178930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.180218:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.180305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166784 00000100:00100000:1.0:1788748386.180318:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166784 00000100:00100000:1.0:1788748386.180388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:1.0:1788748386.180400:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10543:x1875638358166784:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748386.180428:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.180455:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c75a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217bb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180632:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180649:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180657:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180665:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180706:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180722:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 57 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748386.180736:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377054208:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748386.180871:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.180880:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748386.180888:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb518700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377054336:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748386.180926:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748386.181995:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166528 00000100:00100000:0.0:1788748386.182046:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166528 00010000:00010000:0.0:1788748386.182176:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 58 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748386.182289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788748386.182302:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:2347:x1875638358166528:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748386.182319:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748386.182326:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 58 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.182339:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 58 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.182365:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.182371:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.182380:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.182387:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748386.182509:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:2347:x1875638358166528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.182524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1788748386.188566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.188896:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358166912 00000100:00100000:0.0:1788748386.188909:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358166912 00010000:00010000:1.0:1788748386.188972:0:5845:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000013c09685 x1875638377054208) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 58 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.188973:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 58 pid: 8052 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.189004:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217b4 expref: 58 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748386.189080:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377054208:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748386.189101:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb518700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377054336:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748386.189129:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00010000:00010000:1.0:1788748386.189130:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748386.189138:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748386.189145:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:2348:x1875638358166912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748386.189152:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189167:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748386.189174:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189176:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189200:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189876:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217a6 expref: 57 pid: 8052 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189897:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.189902:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189911:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.189920:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.190956:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.190973:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.190986:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1788748386.191003:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:0.0:1788748386.191124:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:2348:x1875638358166912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1977us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.191137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00010000:00010000:1.0:1788748386.191244:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7c75a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.191288:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.191297:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748386.191301:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748386.191304:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748386.191343:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10543:x1875638358166784:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 10946us (11133us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788748386.191350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:2.0:1788748386.202718:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.202934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167168 00000100:00100000:0.0:1788748386.202962:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167168 00000100:00100000:0.0:1788748386.203226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748386.203239:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed423850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10543:x1875638358167168:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1788748386.203263:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748386.203297:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c6c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521791 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.203321:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748386.203327:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748386.203407:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed423850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358167168:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 171us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.203415:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788748386.215679:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.215822:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167296 00000100:00100000:2.0:1788748386.215835:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167296 00000100:00100000:2.0:1788748386.215910:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:2.0:1788748386.215923:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358167296:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:2.0:1788748386.216131:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.216152:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.216167:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748386.216416:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788748386.217238:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358167296:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 1310us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.217251:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:1.0:1788748386.219428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.219544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167424 00000100:00100000:3.0:1788748386.219574:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167424 00000100:00100000:3.0:1788748386.219651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:3.0:1788748386.219662:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:10543:x1875638358167424:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748386.219688:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748386.219713:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217c2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.219782:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.219794:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.220076:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.220096:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.220112:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:3.0:1788748386.220116:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748386.220120:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.220128:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e400, rc 0) 00000100:00100000:3.0:1788748386.220202:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10543:x1875638358167424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 541us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.220210:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00010000:00010000:1.0:1788748386.414206:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788748386.736737:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748386.736750:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748386.736795:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788748386.736804:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748386.736984:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb519f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377054464:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788748386.738698:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748386.750150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.753551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167552 00000100:00100000:3.0:1788748386.753599:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167552 00000100:00100000:3.0:1788748386.753770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:3.0:1788748386.753783:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358167552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748386.753828:0:5844:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748386.753986:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358167552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 205us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.753994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:0.0:1788748386.756868:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb519f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377054464:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748386.762956:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.763369:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167680 00000100:00100000:3.0:1788748386.763384:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167680 00000100:00100000:3.0:1788748386.763878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:3.0:1788748386.763892:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10544:x1875638358167680:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788748386.767253:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.767494:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.767511:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775370:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775401:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775417:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775459:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775487:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775495:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748386.775559:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788748386.775574:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748386.775592:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775607:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775615:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775622:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775640:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748386.775644:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.775653:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776224:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:3.0:1788748386.776231:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748386.776291:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776315:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c77d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776336:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776342:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776349:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776356:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748386.776360:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776368:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776379:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99cec9769600) 00010000:00010000:3.0:1788748386.776383:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748386.776386:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776393:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c784 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776412:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776418:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776432:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776438:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748386.776441:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776449:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776457:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:3.0:1788748386.776460:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748386.776463:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.776469:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c78b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.778103:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10544:x1875638358167680:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 14200us (15150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.778120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:1.0:1788748386.787183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.787336:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358167936 00000100:00100000:2.0:1788748386.787346:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358167936 00000100:00100000:2.0:1788748386.787447:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1788748386.787468:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:10544:x1875638358167936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748386.787489:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748386.787510:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c792 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217c9 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.787617:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.787632:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.787900:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748386.787932:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788748386.788068:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788077:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788084:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788090:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748386.788094:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788102:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788114:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748386.788118:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748386.788123:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788129:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788171:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c792 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c9 expref: 58 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788181:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:2.0:1788748386.788184:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748386.788195:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c792 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c9 expref: 58 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.788205:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748386.788271:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358167936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 806us (1098us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1788748386.788279:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1788748386.792925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.793070:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358168064 00000100:00100000:1.0:1788748386.793080:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358168064 00000100:00100000:1.0:1788748386.793129:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1788748386.793140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358168064:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748386.793186:0:5845:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748386.793280:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358168064:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.793302:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1788748386.799719:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.800437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358168320 00000100:00100000:3.0:1788748386.800453:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358168320 00000100:00100000:3.0:1788748386.800515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1788748386.800525:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358168320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748386.800556:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748386.800564:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788748386.800591:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7c737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ad expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.800628:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748386.800648:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748386.800662:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217d0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748386.801813:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788748386.802384:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c7ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.802476:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.802489:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.802563:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d0 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.802581:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d0 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.802589:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cec9769600) 00010000:00010000:3.0:1788748386.802592:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748386.802595:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e200, rc 0) 00000100:00100000:3.0:1788748386.802945:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10544:x1875638358168320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2420us (3234us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788748386.802954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1788748386.809349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.809474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358168576 00000100:00100000:3.0:1788748386.809485:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358168576 00000100:00100000:3.0:1788748386.809552:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:3.0:1788748386.809563:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10544:x1875638358168576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748386.809620:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748386.809902:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c7ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d0 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.809921:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cec9769600) 00010000:00010000:3.0:1788748386.809932:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748386.809960:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.809974:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.809985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810319:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810328:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810385:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810408:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810415:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810421:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748386.810424:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810431:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810440:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:3.0:1788748386.810443:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748386.810448:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810465:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c7bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810475:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810481:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810487:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810492:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748386.810504:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810511:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810519:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc590a9d0 (ffff99cec9769c00) 00010000:00010000:3.0:1788748386.810521:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748386.810524:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.810541:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c7c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc590a9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.810624:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358168576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788748386.810631:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:0.0:1788748386.815265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.815473:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358168704 00000100:00100000:1.0:1788748386.815483:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358168704 00000100:00100000:1.0:1788748386.815541:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1788748386.815551:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:10544:x1875638358168704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748386.815570:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.815591:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7c7ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217d7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815624:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815636:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815648:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815740:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7c7ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815772:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.815781:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748386.815784:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748386.815788:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8400, rc 0) 00000100:00100000:1.0:1788748386.815843:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10544:x1875638358168704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 293us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.815856:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:0.0:1788748386.819775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.819907:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358168960 00000100:00100000:2.0:1788748386.819916:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358168960 00000100:00100000:2.0:1788748386.819971:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1788748386.819982:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:10544:x1875638358168960:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748386.820103:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.820119:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.820130:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748386.820365:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788748386.820374:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303863359243ns, next at 304863357190ns, rc = 0 00000004:00010000:2.0:1788748386.820461:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000022be0ec2 reply state 00000000b31b9c86 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748386.820470:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748386.820568:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:10544:x1875638358168960:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 588us (801us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788748386.820575:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:0.0:1788748386.824498:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.824579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169088 00000100:00100000:1.0:1788748386.824589:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169088 00000100:00100000:1.0:1788748386.824654:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:1.0:1788748386.824666:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:10544:x1875638358169088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748386.824689:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.824709:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217de expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.824778:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.824793:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.824812:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748386.824815:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748386.824819:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9e00, rc 0) 00000100:00100000:1.0:1788748386.824880:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:10544:x1875638358169088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 216us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.824886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00010000:00010000:2.0:1788748386.825698:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825709:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825717:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825723:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748386.825727:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825735:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825977:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:2.0:1788748386.825982:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748386.825987:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.825995:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c7d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748386.829648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.829727:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169216 00000100:00100000:1.0:1788748386.829738:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169216 00000100:00100000:1.0:1788748386.829830:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1788748386.829842:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef68fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358169216:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788748386.830195:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef68fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358169216:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 354us (567us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788748386.830214:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00080000:2.0:1788748386.830529:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748386.834339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.834417:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169472 00000100:00100000:3.0:1788748386.834426:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169472 00000100:00100000:3.0:1788748386.834489:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1788748386.834498:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:10544:x1875638358169472:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788748386.834982:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:10544:x1875638358169472:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 482us (650us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788748386.834990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1788748386.839234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.839392:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169728 00000100:00100000:2.0:1788748386.839403:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169728 00000100:00100000:2.0:1788748386.839462:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1788748386.839473:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:10544:x1875638358169728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788748386.839867:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:10544:x1875638358169728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 394us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.839888:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1788748386.842635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.842873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169856 00000100:00100000:1.0:1788748386.842882:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169856 00000100:00100000:1.0:1788748386.842975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:1.0:1788748386.842986:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:10544:x1875638358169856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748386.843006:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.843054:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217e5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843130:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843144:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843155:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748386.843208:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748386.843227:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843251:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7c7e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217e5 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843269:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217e5 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.843277:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748386.843292:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788748386.843297:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8e00, rc 0) 00000100:00100000:1.0:1788748386.843393:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:10544:x1875638358169856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 407us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.843401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1788748386.846558:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.846968:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358169984 00000100:00100000:2.0:1788748386.846978:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358169984 00000100:00100000:2.0:1788748386.847106:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748386.847117:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358169984:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748386.847135:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748386.847155:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217ec expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748386.847180:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e2262, blocks: 0x1 00010000:00010000:2.0:1788748386.847200:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1788748386.847205:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748386.847215:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.847232:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.847246:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748386.847299:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358169984:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 184us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.847307:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788748386.850433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.850564:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170240 00000100:00100000:3.0:1788748386.850574:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170240 00000100:00100000:3.0:1788748386.850630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:3.0:1788748386.850650:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:10544:x1875638358170240:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748386.850771:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:10544:x1875638358170240:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.850780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1788748386.858707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748386.858922:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170368 00000100:00100000:0.0:1788748386.858932:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170368 00000100:00100000:0.0:1788748386.859002:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788748386.859049:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:10544:x1875638358170368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748386.859078:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748386.859098:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217f3 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.859130:0:8053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.859140:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748386.859144:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748386.859150:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 11 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.859199:0:8053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.859214:0:8053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 11 pid: 6697 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748386.859229:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5294a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8053:1875638377054592:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748386.859312:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748386.863958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.864106:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170496 00000100:00100000:2.0:1788748386.864115:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170496 00010000:00010000:2.0:1788748386.864157:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 12 pid: 6697 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748386.864231:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788748386.864241:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2347:x1875638358170496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748386.864257:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748386.864278:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 12 pid: 6697 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.864292:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 12 pid: 6697 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.864316:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748386.864321:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748386.864329:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 12 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.864339:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 12 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.864376:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 12 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748386.864390:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875638377054720:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788748386.864478:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b240 going to sleep for 11 seconds 00010000:00010000:0.0:1788748386.865213:0:8053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7c7f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217ec expref: 12 pid: 6697 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748386.865231:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5294a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8053:1875638377054592:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748386.865262:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 11 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.865272:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748386.865316:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:10544:x1875638358170368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 6304us (6618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748386.865323:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748386.872093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.872666:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170624 00000100:00100000:3.0:1788748386.872676:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170624 00002000:00100000:3.0:1788748386.872729:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99cefb51b800 x1875638358170624/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:132/0 lens 504/0 e 0 to 0 dl 1788748397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748386.872741:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefb51b800 with x1875638358170624 ext(0->12) 00002000:00010000:3.0:1788748386.872854:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefb51b800 00000100:00100000:3.0:1788748386.872891:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788748386.872900:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2347:x1875638358170624:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788748386.873557:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875638377054720:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788748386.873589:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748386.873627:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358170624:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 727us (1542us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788748386.873635:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:3.0:1788748386.873653:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99cefb51b800 x1875638358170624/t4294967308(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:132/0 lens 504/448 e 0 to 0 dl 1788748397 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748386.873662:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefb51b800 with x1875638358170624 ext(0->12) 00002000:00010000:3.0:1788748386.873667:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefb51b800 00000100:00100000:2.0:1788748386.874782:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2347:x1875638358170496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 10538us (10828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.874794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788748386.880086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.880265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170752 00000100:00100000:3.0:1788748386.880274:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170752 00000100:00100000:3.0:1788748386.880355:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1788748386.880365:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:10544:x1875638358170752:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788748386.926473:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:10544:x1875638358170752:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 46098us (46383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748386.926487:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000001:00080000:1.0:1788748386.926815:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967393 is committed 00000001:00080000:1.0:1788748386.926951:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:1.0:1788748386.926968:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788748386.926972:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788748386.926997:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788748386.927037:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ceece1ba80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788748386.927041:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec6671a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ceece1b6c0 00000020:00080000:1.0:1788748386.927044:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec6671800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cefb51cc00 00000020:00080000:1.0:1788748386.927090:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ceece1b0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788748386.927094:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec6671300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ceece1bb40 00000020:00080000:1.0:1788748386.927096:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec6671500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc5076400 00000001:00080000:1.0:1788748386.927106:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1788748386.927122:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788748386.927134:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1788748386.929044:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377054976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788748386.929120:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788748386.930051:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1788748386.930668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377054848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788748386.930741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748386.932119:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748386.932134:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377055104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748386.933292:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748386.934626:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377054976 00000100:00100000:2.0:1788748386.934640:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377054976 00000100:00100000:2.0:1788748386.934737:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377054848 00000100:00100000:2.0:1788748386.934741:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377054848 00000100:00100000:3.0:1788748386.935096:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377055104 00000100:00100000:3.0:1788748386.935102:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377055104 00000100:00100000:3.0:1788748386.935144:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748386.935154:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377054976:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788748386.935321:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:0.0:1788748386.936064:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748386.936070:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748386.937318:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748386.937331:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1875638377055104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788748386.937362:0:6695:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788748386.937398:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e2261, atime: 0x6a9e2261, ctime: 0x6a9e2261, blocks: 0x1 00010000:00010000:2.0:1788748386.937407:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.937423:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1788748386.937427:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748386.937433:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.937468:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.937478:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.937484:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.937504:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748386.938714:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748386.938724:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.938734:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748386.938739:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.938815:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748386.939187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748386.939259:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3308:x1875638377055104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1930us (5970us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788748386.939268:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788748386.939316:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.939325:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1580adf/0x5b377f42a7a7c802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748386.939516:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788748386.939520:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788748386 00002000:00010000:3.0:1788748386.939522:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788748386.939525:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788748386 -> 1788748386 00002000:00010000:3.0:1788748386.939527:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1788748386.939602:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748386.939605:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748386.939607:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748386.939994:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358170880 00000100:00100000:2.0:1788748386.940003:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358170880 00000100:00100000:2.0:1788748386.940070:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748386.940071:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875638377054976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4919us (10951us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788748386.940078:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748386.940078:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875638377054848:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788748386.940093:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748386.940099:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2348:x1875638358170880:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00002000:00080000:2.0:1788748386.940101:0:6695:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788748386.940116:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.940131:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 12 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.940140:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788748386.940152:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748386.940156:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.940190:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 12 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.940204:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 12 pid: 8053 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748386.940220:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377055232:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748386.940285:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b240 going to sleep for 11 seconds 00000004:00080000:2.0:1788748386.940329:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cefb51ad80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788748386.940335:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377055104:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788748386.940347:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cf01ee8e00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788748386.940351:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377054976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788748386.945798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748386.946469:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377055232:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748386.946499:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.949041:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171008 00000100:00100000:3.0:1788748386.949065:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171008 00010000:00010000:3.0:1788748386.949112:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 13 pid: 8053 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.949172:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788748386.949182:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2348:x1875638358171008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748386.949195:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748386.949210:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 13 pid: 8053 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.949224:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 13 pid: 8053 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.949265:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d81bd9a/0x5b377f42a7a7c5c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521752 expref: 13 pid: 8053 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.949282:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748386.949286:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748386.949291:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.949300:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.949333:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748386.949396:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2348:x1875638358171008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 215us (3607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.949403:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00010000:00010000:1.0:1788748386.949704:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.949716:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.949726:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.949733:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.949759:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788748386.952338:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875638377054848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12252us (21587us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788748386.952610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788748386.952709:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cf01ee9180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788748386.952716:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377054848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788748386.953289:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748386.953300:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.953314:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748386.953319:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.953331:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.953385:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.953393:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7c809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.953415:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748386.953418:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748386.953420:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788748386.989319:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788748386.989336:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788748386.989355:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788748386.989360:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788748386.990824:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358170880:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 50717us (51631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.990922:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:2.0:1788748386.993431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748386.993680:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171264 00000100:00100000:3.0:1788748386.993691:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171264 00000100:00100000:3.0:1788748386.993763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788748386.993773:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10544:x1875638358171264:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748386.993827:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748386.993867:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7c7ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217e5 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.993885:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:3.0:1788748386.993890:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748386.993920:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.993933:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.993956:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748386.994265:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003b361d61 reply state 0000000073bfe78a transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.994275:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748386.994385:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:10544:x1875638358171264:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 613us (960us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788748386.994393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00010000:00010000:1.0:1788748386.997625:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997642:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997670:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997675:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748386.997680:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997688:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997703:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748386.997706:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748386.997711:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.997717:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7c810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.004120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748387.004543:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171392 00000100:00100000:0.0:1788748387.004553:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171392 00000100:00100000:0.0:1788748387.004609:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:0.0:1788748387.004619:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358171392:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788748387.005125:0:8053:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788748387.005129:0:8053:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788748386 -> 1788748385 00002000:00010000:0.0:1788748387.005132:0:8053:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788748385 00002000:00010000:0.0:1788748387.005134:0:8053:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788748386 -> 1788748385 00002000:00010000:0.0:1788748387.005136:0:8053:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788748387.005254:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358171392:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 634us (1142us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788748387.005262:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788748387.011623:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748387.012378:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171648 00000100:00100000:1.0:1788748387.012390:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171648 00000100:00100000:1.0:1788748387.012517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:1.0:1788748387.012540:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:10544:x1875638358171648:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788748387.012617:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.012635:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.012645:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.012697:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.012712:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 15 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.012725:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377055360:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748387.012943:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875a300 going to sleep for 11 seconds 00000100:00080000:0.0:1788748387.013342:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748387.018253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748387.018631:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171776 00000100:00100000:0.0:1788748387.018641:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171776 00010000:00010000:0.0:1788748387.018682:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748387.018726:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1788748387.018759:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:2347:x1875638358171776:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748387.018774:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748387.018782:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.018795:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.018817:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:0.0:1788748387.018822:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.019503:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.019516:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.019548:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748387.019613:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:2347:x1875638358171776:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 855us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748387.019622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00010000:00010000:1.0:1788748387.019974:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c7d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217d7 expref: 15 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.019995:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377055360:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748387.020120:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020131:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020138:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020263:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020273:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020281:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020298:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.020303:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020312:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020328:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748387.020331:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788748387.020335:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.020342:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7c817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.020395:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10544:x1875638358171648:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 7868us (8782us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788748387.020404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:2.0:1788748387.024429:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748387.024492:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358171904 00000100:00100000:1.0:1788748387.024502:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358171904 00000100:00100000:1.0:1788748387.024561:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748387.024571:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2350:x1875638358171904:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748387.024614:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.024634:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.024663:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788748387.024668:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748387.024673:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.024711:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 7 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.024726:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 7 pid: 8053 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.024741:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377055488:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748387.024819:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748387.032349:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377055488:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748387.032379:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.033621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748387.033892:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358172032 00000100:00100000:3.0:1788748387.033902:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358172032 00010000:00010000:3.0:1788748387.033941:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 8 pid: 8053 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748387.034067:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788748387.034078:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358172032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748387.034092:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748387.034114:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 8 pid: 8053 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.034129:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 8 pid: 8053 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.034169:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d47908ec/0x5b377f42a7a7c7fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217f3 expref: 8 pid: 8053 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.034214:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748387.034219:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748387.034225:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.034234:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.034266:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748387.034317:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748387.034361:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358172032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 284us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748387.034369:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00010000:00010000:1.0:1788748387.034395:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034424:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034440:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034448:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034455:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748387.034460:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034469:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034485:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.034493:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7c81e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.034543:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358171904:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 9973us (10121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.034551:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1788748387.041474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748387.046959:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358172288 00000100:00100000:0.0:1788748387.046975:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358172288 00000100:00100000:0.0:1788748387.047239:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1788748387.047252:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10544:x1875638358172288:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788748387.047330:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047379:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047585:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047596:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047606:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047641:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.047656:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 15 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748387.047669:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377055616:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748387.047768:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748387.053935:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377055616:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748387.053968:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748387.054172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.054241:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358172416 00000100:00100000:2.0:1788748387.054248:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358172416 00010000:00010000:2.0:1788748387.054284:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.054351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788748387.054361:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+16:2347:x1875638358172416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748387.054376:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748387.054384:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054397:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054418:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7c7df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217de expref: 16 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054434:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:2.0:1788748387.054439:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054448:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054484:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.054513:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748387.054575:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:2347:x1875638358172416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 214us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748387.054584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00010000:00010000:0.0:1788748387.054829:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.054913:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748387.055118:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788748387.055366:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788748387.055412:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788748387.055491:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875638377055744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788748387.055537:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748387.055613:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748387.062414:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377055744 00000100:00100000:2.0:1788748387.062447:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377055744 00000100:00100000:2.0:1788748387.062582:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748387.062594:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875638377055744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788748387.062726:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875638377055744:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (7187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748387.062734:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748387.062812:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788748387.062818:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788748387.062836:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cf01ee8e00, transno 4294967309 00000100:00100000:0.0:1788748387.062859:0:5846:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99cf01ee9180 x1875638377054848/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788748402 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748387.062873:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875638377055744:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788748387.063412:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788748387.063484:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875638377055872:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788748387.063526:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748387.070412:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377055872 00000100:00100000:3.0:1788748387.070428:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377055872 00000100:00100000:3.0:1788748387.070491:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748387.070501:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875638377055872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788748387.070880:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1875638377055872:12345-0@lo:1000:mdt00_002.0 Request processed in 380us (7352us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788748387.070889:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748387.071351:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748387.071388:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5295880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875638377055872:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788748387.071440:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071449:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071456:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071462:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.071466:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071472:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071485:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef200) 00010000:00010000:1.0:1788748387.071489:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748387.071493:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071499:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c82c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071528:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071534:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071540:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071556:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.071559:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071566:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071574:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748387.071576:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748387.071583:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071593:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071602:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.071635:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748387.071649:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377056000:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748387.071716:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748387.075604:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee50e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377056000:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788748387.075633:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075663:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c76f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075695:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075708:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075720:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075731:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075737:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075760:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075766:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.075770:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075777:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075788:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748387.075791:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748387.075795:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075807:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075819:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075825:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075831:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075835:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.075838:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075843:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075851:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748387.075853:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748387.075856:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.075861:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.075949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748387.076228:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10544:x1875638358172288:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 28977us (34760us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1788748387.076239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000020:00080000:1.0:1788748387.076252:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788748387.076292:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358172544 00000100:00100000:1.0:1788748387.076299:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358172544 00000100:00100000:1.0:1788748387.076343:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788748387.076353:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10543:x1875638358172544:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:1.0:1788748387.076441:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10543:x1875638358172544:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 89us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.076448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000040:00080000:0.0:1788748387.076700:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748387.076705:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748387.076734:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788748387.076740:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748387.079608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748387.079700:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358172800 00000100:00100000:1.0:1788748387.079710:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358172800 00000100:00100000:1.0:1788748387.079768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1788748387.079778:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:10544:x1875638358172800:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788748387.080492:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788748387.080597:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:1.0:1788748387.080642:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080657:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080668:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080677:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080682:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080687:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.080720:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788748387.080811:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:10544:x1875638358172800:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1033us (1211us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788748387.080819:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000020:00080000:1.0:1788748387.080824:0:5847:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748387.081665:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748387.081675:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.081683:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748387.081697:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.081706:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.081719:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cecfaef900) 00010000:00010000:3.0:1788748387.081723:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748387.081728:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.081735:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7c83a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.081755:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748387.081757:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748387.081759:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748387.084629:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.084900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173056 00000100:00100000:2.0:1788748387.084909:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173056 00000100:00100000:2.0:1788748387.085220:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:2.0:1788748387.085231:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:10543:x1875638358173056:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:2.0:1788748387.085640:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788748387.086422:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:10543:x1875638358173056:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 1189us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748387.086505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:0.0:1788748387.119978:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.120212:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173184 00000100:00100000:2.0:1788748387.120221:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173184 00000100:00100000:2.0:1788748387.120271:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788748387.120282:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:10547:x1875638358173184:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748387.120304:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748387.120324:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265217fa expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.120384:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.120399:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.120422:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121559:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121571:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121578:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121795:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121805:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121811:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121838:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748387.121848:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 21 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.121858:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377056128:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748387.122196:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd3d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748387.125882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748387.126357:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173440 00000100:00100000:1.0:1788748387.126366:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173440 00000100:00100000:1.0:1788748387.127122:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788748387.127135:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:5588:x1875638358173440:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788748387.127379:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:5588:x1875638358173440:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 246us (1502us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788748387.127387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748387.127396:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377056128:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748387.127626:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.133493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748387.133646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173568 00000100:00100000:0.0:1788748387.133656:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173568 00010000:00010000:0.0:1788748387.133694:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 23 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748387.133733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1788748387.133743:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:2347:x1875638358173568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748387.133768:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748387.133775:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 23 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133789:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 23 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133810:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7c761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217bb expref: 23 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133826:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748387.133832:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133841:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133848:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748387.133880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748387.133938:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:2347:x1875638358173568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748387.133946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00010000:00010000:1.0:1788748387.135843:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135858:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748387.135904:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788748387.135908:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748387.135929:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135943:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135953:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135976:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135983:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.135990:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.135995:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136002:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136065:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:1.0:1788748387.136069:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748387.136075:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136081:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136097:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136103:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136109:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136114:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748387.136123:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136130:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136138:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cec6646f00) 00010000:00010000:1.0:1788748387.136141:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748387.136144:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136149:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c84f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136193:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217fa expref: 22 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136208:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217fa expref: 21 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748387.136216:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748387.136219:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748387.136221:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3a00, rc 0) 00000100:00100000:1.0:1788748387.138179:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10547:x1875638358173184:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 17889us (18199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.138191:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1788748387.368718:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.368764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.368791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173952 00000100:00100000:2.0:1788748387.368799:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173952 00000100:00100000:2.0:1788748387.368856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1788748387.368866:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358173952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748387.368933:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358173952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748387.368941:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00080000:2.0:1788748387.368962:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748387.368991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748387.369119:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173824 00000100:00100000:2.0:1788748387.369123:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173824 00000100:00100000:2.0:1788748387.369152:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788748387.369159:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358173824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748387.369191:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358173824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748387.369198:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00080000:2.0:1788748387.369211:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748387.370467:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358173696 00000100:00100000:1.0:1788748387.370483:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358173696 00000100:00100000:1.0:1788748387.370525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 283 00000100:00100000:1.0:1788748387.370534:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358173696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748387.370592:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358173696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.370600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 283 00010000:00010000:0.0:1788748387.437204:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748387.630853:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788748387.631621:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788748387.631710:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:3.0:1788748388.042653:0:12055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788748388.042664:0:12055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748388.042718:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788748388.042725:0:12055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788748388.081197:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748388.081208:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748388.081256:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788748388.081265:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748388.081801:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377056256:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748388.081898:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee51a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748388.086084:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377056256:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748388.086545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748388.087634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358174080 00000100:00100000:1.0:1788748388.087646:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358174080 00000100:00100000:1.0:1788748388.087710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:1.0:1788748388.087720:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10558:x1875638358174080:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748388.087754:0:5846:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748388.087855:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10558:x1875638358174080:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 136us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748388.087863:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:3.0:1788748388.093758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748388.093791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358174336 00000100:00100000:2.0:1788748388.093809:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358174336 00000100:00100000:2.0:1788748388.093883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:2.0:1788748388.093893:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:10558:x1875638358174336:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748388.093914:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748388.093934:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c85d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521801 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.094074:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.094088:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.094101:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748388.094113:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788748388.094243:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7c85d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521801 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.094262:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521801 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.094270:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748388.094273:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748388.094276:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2e00, rc 0) 00000100:00100000:2.0:1788748388.094886:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:10558:x1875638358174336:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 991us (1134us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788748388.094895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:3.0:1788748388.106610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748388.106657:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748388.106732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358174592 00000100:00100000:1.0:1788748388.106742:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358174592 00000100:00100000:1.0:1788748388.106800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:1.0:1788748388.106810:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:10558:x1875638358174592:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788748388.106899:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.106916:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.106928:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107150:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107157:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107164:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107170:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748388.107174:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107181:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107193:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:1.0:1788748388.107196:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748388.107201:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748388.107207:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7c872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748388.107350:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:10558:x1875638358174592:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 540us (747us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788748388.107358:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000040:00080000:1.0:1788748388.107465:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748388.107469:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748388.107969:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788748388.107984:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748388.109608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358174720 00000100:00100000:2.0:1788748388.109622:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358174720 00000100:00100000:2.0:1788748388.109689:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748388.109699:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:2350:x1875638358174720:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748388.109715:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748388.109739:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7c864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521801 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748388.109757:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748388.109762:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748388.109817:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:2350:x1875638358174720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 119us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748388.109837:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788748388.115785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748388.115820:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358174976 00000100:00100000:3.0:1788748388.115841:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358174976 00000100:00100000:3.0:1788748388.115888:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788748388.115897:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:10558:x1875638358174976:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788748388.116180:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:10558:x1875638358174976:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 283us (403us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788748388.116188:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00010000:00010000:3.0:1788748388.461350:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748388.590693:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.590766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.590834:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748388.590842:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.590872:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.590926:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377056512 00000100:00100000:0.0:1788748388.590934:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377056512 00000100:00100000:0.0:1788748388.590985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788748388.590996:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377056512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748388.591063:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377056768:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.591084:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377056512:12345-0@lo:400:kworker.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.591093:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788748388.591101:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.591191:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377057024:0@lo:400:kworker.0 00000100:00100000:1.0:1788748388.591255:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377056896:0@lo:400:kworker.0 00000100:00100000:3.0:1788748388.592832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.597661:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.597739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.597827:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377056768 00000100:00100000:0.0:1788748388.597834:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377056768 00000100:00100000:0.0:1788748388.597910:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057024 00000100:00100000:0.0:1788748388.597914:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057024 00000100:00100000:0.0:1788748388.597938:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748388.597947:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875638377056768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.598003:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875638377056768:12345-0@lo:400:kworker.0 Request processed in 57us (6903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.598042:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748388.598072:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748388.598078:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377057024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.598113:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377057024:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.598118:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748388.598141:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788748388.598146:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788748388.598160:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ceecddd500, transno 4294967301 00000004:00080000:0.0:1788748388.598168:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788748388.598176:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cefb51ad80, transno 4294967304 00000100:00100000:0.0:1788748388.598181:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377057024:0@lo:400:kworker.0 00000100:00080000:0.0:1788748388.598448:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748388.598453:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748388.598605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377056384 00000100:00100000:0.0:1788748388.598610:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377056384 00000100:00100000:0.0:1788748388.598637:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788748388.598644:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377056384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.598684:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377056384:12345-0@lo:400:kworker.0 Request processed in 41us (7811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.598690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788748388.598723:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.601867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748388.601988:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377056896 00000100:00100000:1.0:1788748388.601997:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377056896 00000100:00100000:1.0:1788748388.602122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788748388.602133:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377056896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748388.602195:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377056896:12345-0@lo:400:kworker.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748388.602201:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788748388.602251:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377056896:0@lo:400:kworker.0 00000100:00080000:0.0:1788748388.604802:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748388.605690:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377056768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748388.607416:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748388.608201:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377056640 00000100:00100000:2.0:1788748388.608211:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377056640 00000100:00100000:2.0:1788748388.608291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788748388.608300:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377056640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748388.608372:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377056640:12345-0@lo:400:kworker.0 Request processed in 72us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748388.608379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788748388.608584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748388.609132:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748389.101332:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748389.101356:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377057152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748389.101437:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748389.101574:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057152 00000100:00100000:1.0:1788748389.101583:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057152 00000100:00100000:1.0:1788748389.101637:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748389.101647:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377057152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748389.101682:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748389.101732:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377057152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748389.101739:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788748389.102006:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377057152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788748389.485860:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748389.624928:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748389.624961:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377057280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748389.625082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748389.625179:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057280 00000100:00100000:0.0:1788748389.625188:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057280 00000100:00100000:0.0:1788748389.625246:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748389.625255:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377057280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748389.625298:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748389.625346:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377057280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748389.625353:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748389.625548:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377057280:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788748389.954886:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788748389.954898:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748389.954953:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788748389.954960:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748390.131197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748390.131366:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175232 00000100:00100000:0.0:1788748390.131379:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175232 00000100:00100000:0.0:1788748390.131603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:0.0:1788748390.131619:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:10579:x1875638358175232:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748390.131654:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748390.131679:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521808 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.131820:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c880 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.131838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c880 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.131855:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c880 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748390.131888:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788748390.132084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5000/0x5b377f42a7a7c879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521808 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.132107:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521808 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.132116:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:0.0:1788748390.132120:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788748390.132124:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4200, rc 0) 00000100:00100000:0.0:1788748390.133059:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:10579:x1875638358175232:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1438us (2050us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788748390.133072:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00080000:3.0:1788748390.133478:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748390.136221:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748390.136609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175360 00000100:00100000:3.0:1788748390.136622:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175360 00000100:00100000:3.0:1788748390.136817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1788748390.136829:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:10579:x1875638358175360:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788748390.136914:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.136935:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.136949:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137001:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137009:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137382:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137390:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748390.137395:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137404:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137416:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:3.0:1788748390.137420:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748390.137425:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748390.137431:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c88e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748390.138362:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:10579:x1875638358175360:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 1525us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748390.138375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1788748390.216817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748390.217875:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175488 00000100:00100000:0.0:1788748390.217891:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175488 00000100:00100000:0.0:1788748390.218002:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00080000:3.0:1788748390.218082:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748390.218110:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358175488:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748390.218139:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748390.218243:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f07c50/0x5b377f42a7a7c895 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652180f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748390.218278:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e2261, atime: 0x6a9e2261, ctime: 0x6a9e2261, blocks: 0xb 00010000:00010000:0.0:1788748390.218306:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788748390.218312:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748390.218323:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f07c50/0x5b377f42a7a7c895 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652180f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.218364:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6f07c50/0x5b377f42a7a7c895 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652180f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748390.218380:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5000, rc 0) 00000100:00100000:0.0:1788748390.218578:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2349:x1875638358175488:12345-192.168.203.4@tcp:101:cat.0 Request processed in 564us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748390.218586:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788748390.223940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748390.224324:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175616 00000100:00100000:1.0:1788748390.224337:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175616 00002000:00100000:1.0:1788748390.224410:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99cefbb4d500 x1875638358175616/t0(0) o3->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:136/0 lens 488/0 e 0 to 0 dl 1788748401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748390.224423:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefbb4d500 with x1875638358175616 ext(0->4095) 00002000:00010000:1.0:1788748390.224489:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefbb4d500 00000100:00100000:1.0:1788748390.224567:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748390.224577:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2350:x1875638358175616:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:1.0:1788748390.228238:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2350:x1875638358175616:12345-192.168.203.4@tcp:3:cat.0 Request processed in 3642us (4293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788748390.228257:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:1.0:1788748390.228275:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99cefbb4d500 x1875638358175616/t0(0) o3->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:136/0 lens 488/4536 e 0 to 0 dl 1788748401 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748390.228286:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cefbb4d500 with x1875638358175616 ext(0->4095) 00002000:00010000:1.0:1788748390.228295:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cefbb4d500 00010000:00010000:0.0:1788748390.509717:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748391.533212:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748392.231671:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788748392.231692:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ceece1bb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788748392.231697:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec5098900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ceece1bc00 00000020:00080000:1.0:1788748392.231700:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec5098b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cefd7cf800 00000020:00080000:1.0:1788748392.231732:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788748392.231990:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788748392.232672:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788748392.238980:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788748392.239307:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788748392.239402:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1788748392.490792:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748392.490840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748392.490881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748392.490921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748392.490939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175744 00000100:00100000:3.0:1788748392.490956:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175744 00000100:00100000:2.0:1788748392.490982:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748392.491084:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176256 00000100:00100000:2.0:1788748392.491095:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176256 00000100:00100000:3.0:1788748392.491103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 285 00000100:00100000:3.0:1788748392.491119:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358175744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748392.491165:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358175872 00000100:00100000:2.0:1788748392.491170:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358175872 00000100:00100000:2.0:1788748392.491206:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1788748392.491218:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358176256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748392.491237:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358175744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 121us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748392.491247:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 285 00000100:00100000:3.0:1788748392.491322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:3.0:1788748392.491333:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2349:x1875638358175872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748392.491368:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2349:x1875638358175872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748392.491374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00080000:3.0:1788748392.491402:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748392.491506:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176000 00000100:00100000:1.0:1788748392.491513:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176000 00000100:00100000:1.0:1788748392.491564:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176128 00000100:00100000:1.0:1788748392.491569:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176128 00000100:00100000:3.0:1788748392.491587:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:3.0:1788748392.491599:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358176000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748392.491639:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2349:x1875638358176000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748392.491691:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358176256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 473us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748392.491700:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00080000:0.0:1788748392.491890:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748392.491895:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748392.503314:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1788748392.503337:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358176128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748392.503422:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358176128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 96us (12441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748392.503430:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788748392.506862:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:3.0:1788748392.559574:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748393.592765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748393.709846:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377057792:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.709924:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748393.710049:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377057408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.710114:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377057536:0@lo:400:kworker.0 00000100:00100000:3.0:1788748393.710179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377057664:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.710233:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057792 00000100:00100000:0.0:1788748393.710242:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057792 00000100:00100000:0.0:1788748393.710298:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748393.710307:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.710913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748393.711086:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748393.711133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057536 00000100:00100000:2.0:1788748393.711139:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057536 00000100:00100000:2.0:1788748393.711187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788748393.711207:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377057536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.711251:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377057536:12345-0@lo:400:kworker.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748393.711258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788748393.711571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377057920:0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.711609:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748393.711636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057920 00000100:00100000:1.0:1788748393.711640:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057920 00000100:00100000:1.0:1788748393.711677:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788748393.711684:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377057920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.711718:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377057920:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748393.711724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788748393.711810:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377057536:0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.711818:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377058048:0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.711843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748393.711953:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058048 00000100:00100000:1.0:1788748393.711958:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058048 00000100:00100000:1.0:1788748393.711987:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788748393.711994:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377058048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.712235:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377058048:12345-0@lo:400:kworker.0 Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748393.712242:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788748393.712247:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748393.712271:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377057920:0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.712455:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057664 00000100:00100000:2.0:1788748393.712460:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057664 00000100:00100000:2.0:1788748393.712492:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748393.712499:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377057664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748393.712545:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377057664:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748393.712551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748393.712578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377058048:0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.712789:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377057664:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.713070:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377057792:12345-0@lo:400:kworker.0 Request processed in 2762us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.713078:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788748393.713100:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748393.713104:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748393.713106:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748393.713122:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377057408 00000100:00100000:0.0:1788748393.713127:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377057408 00000100:00100000:0.0:1788748393.713162:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788748393.713179:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377057408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.713541:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377057408:12345-0@lo:400:kworker.0 Request processed in 362us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748393.713549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788748393.713626:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788748393.713632:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cf01ee9180, transno 4294967310 00000100:00100000:3.0:1788748393.713635:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377057408:0@lo:400:kworker.0 00000004:00080000:2.0:1788748393.713676:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788748393.713694:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788748394.221517:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748394.221595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748394.221787:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058176 00000100:00100000:0.0:1788748394.221795:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058176 00000100:00100000:0.0:1788748394.221848:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788748394.221858:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377058176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748394.221892:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748394.221945:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377058176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748394.221952:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748394.222369:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377058176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788748394.606216:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748394.733520:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377058304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748394.733603:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748394.734568:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058304 00000100:00100000:0.0:1788748394.734577:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058304 00000100:00100000:0.0:1788748394.734627:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788748394.734637:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377058304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748394.734671:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748394.734718:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377058304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748394.734725:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748394.735499:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377058304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748395.633196:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748396.129560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748396.130059:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176384 00000100:00100000:1.0:1788748396.130070:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176384 00000100:00100000:1.0:1788748396.130153:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1788748396.130178:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10232:x1875638358176384:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788748396.130285:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10232:x1875638358176384:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 109us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748396.130293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00080000:0.0:1788748396.130365:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748396.140297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748396.147307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176640 00000100:00100000:3.0:1788748396.147324:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176640 00000100:00100000:3.0:1788748396.147600:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1788748396.147611:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:10232:x1875638358176640:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788748396.148007:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:10232:x1875638358176640:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 386us (7706us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788748396.148045:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00010000:00010000:0.0:1788748396.655308:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788748397.349746:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1788748397.349780:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788748397.350256:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788748397.350266:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788748397.360062:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748397.360072:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748397.360360:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788748397.360367:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748397.604376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748397.604439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748397.604485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748397.604715:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176768 00000100:00100000:0.0:1788748397.604725:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176768 00000100:00100000:0.0:1788748397.604786:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 287 00000100:00100000:0.0:1788748397.604797:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358176768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748397.604882:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358176768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 87us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748397.604890:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 287 00000100:00100000:1.0:1788748397.605426:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177024 00000100:00100000:1.0:1788748397.605432:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177024 00000100:00100000:1.0:1788748397.605499:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1788748397.605508:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358177024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748397.605548:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2350:x1875638358177024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748397.605556:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1788748397.609253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748397.609299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748397.609515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177280 00000100:00100000:2.0:1788748397.609524:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177280 00000100:00100000:2.0:1788748397.609587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358176896 00000100:00100000:2.0:1788748397.609590:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358176896 00000100:00100000:2.0:1788748397.609616:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1788748397.609625:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358177280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748397.609697:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2350:x1875638358177280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748397.609721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1788748397.609740:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:2.0:1788748397.609747:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2350:x1875638358176896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748397.609778:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2350:x1875638358176896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748397.609784:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:2.0:1788748397.609910:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177152 00000100:00100000:2.0:1788748397.609914:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177152 00000100:00100000:2.0:1788748397.609942:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788748397.609950:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358177152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748397.609991:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2350:x1875638358177152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748397.609998:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00080000:0.0:1788748397.611162:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748397.611170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748397.611172:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788748397.679612:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748398.703922:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748398.784201:0:12308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:33:16 (1788748396) 00000100:00100000:1.0:1788748398.831003:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377058432:0@lo:400:kworker.0 00000100:00100000:1.0:1788748398.831111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748398.831192:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748398.831199:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377058560:0@lo:400:kworker.0 00000100:00100000:1.0:1788748398.831224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748398.831259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058432 00000100:00100000:1.0:1788748398.831267:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058432 00000100:00100000:1.0:1788748398.831310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788748398.831333:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377058432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748398.831385:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377058432:12345-0@lo:400:kworker.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748398.831391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788748398.831420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058560 00000100:00100000:1.0:1788748398.831424:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058560 00000100:00100000:1.0:1788748398.831450:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788748398.831457:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377058560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748398.831487:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377058560:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748398.831493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788748398.831530:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377058560:0@lo:400:kworker.0 00000100:00100000:1.0:1788748398.831539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377058432:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.836719:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377058816:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.836740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377059072:0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.836961:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377058688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.842335:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.842370:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377058944:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.842402:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058816 00000100:00100000:3.0:1788748398.842410:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058816 00000100:00100000:0.0:1788748398.842427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.842461:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788748398.842469:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377058816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.842476:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058944 00000100:00100000:0.0:1788748398.842482:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058944 00000100:00100000:3.0:1788748398.842516:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377058816:12345-0@lo:400:kworker.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748398.842529:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788748398.842535:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788748398.842546:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377058944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788748398.842551:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748398.842558:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748398.842591:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377058816:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.842597:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377058944:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.842618:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788748398.842622:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.842660:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059072 00000100:00100000:3.0:1788748398.842663:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059072 00000100:00100000:0.0:1788748398.842668:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377058944:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.842688:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788748398.842693:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377059072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.842728:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377059072:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748398.842733:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788748398.842742:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748398.844244:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377059072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.848994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.849403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377058688 00000100:00100000:0.0:1788748398.849414:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377058688 00000100:00080000:3.0:1788748398.849461:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748398.849481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788748398.849491:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377058688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.849577:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377058688:12345-0@lo:400:kworker.0 Request processed in 88us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.849585:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748398.850049:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377058688:0@lo:400:kworker.0 00000100:00100000:0.0:1788748399.341825:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748399.341849:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748399.341918:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748399.342101:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059200 00000100:00100000:1.0:1788748399.342110:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059200 00000100:00100000:1.0:1788748399.342166:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788748399.342177:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377059200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748399.342212:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748399.342270:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377059200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748399.342277:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748399.342369:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377059200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788748399.725268:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748399.853467:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748399.853489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377059328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748399.853556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748399.853782:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059328 00000100:00100000:1.0:1788748399.853790:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059328 00000100:00100000:1.0:1788748399.853843:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788748399.853854:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377059328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748399.853906:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748399.854203:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377059328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748399.854214:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748399.854379:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377059328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748400.752310:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748401.025096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748401.025682:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177536 00000100:00100000:1.0:1788748401.025693:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177536 00000100:00080000:3.0:1788748401.025756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748401.025773:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:1.0:1788748401.025784:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:11289:x1875638358177536:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748401.025804:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748401.025825:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7c89c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521816 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025891:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025905:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025918:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025935:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025942:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748401.025949:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026379:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c8b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026389:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026397:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748401.026406:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788748401.026555:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026563:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026569:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026575:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748401.026578:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026585:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026597:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec3e09400) 00010000:00010000:0.0:1788748401.026600:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748401.026604:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026610:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7c8a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026629:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026634:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026640:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026644:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748401.026647:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026653:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026660:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cecfaef200) 00010000:00010000:0.0:1788748401.026663:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748401.026666:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.026671:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7c8aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.027087:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7c89c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521816 expref: 16 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.027105:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521816 expref: 15 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748401.027125:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:0.0:1788748401.027128:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748401.027131:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748401.027262:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:11289:x1875638358177536:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1478us (2174us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788748401.027269:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1788748401.041107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748401.041149:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748401.041250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177792 00000100:00100000:0.0:1788748401.041259:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177792 00000100:00100000:0.0:1788748401.041318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1788748401.041328:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:11289:x1875638358177792:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788748401.041458:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:11289:x1875638358177792:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748401.041467:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:3.0:1788748401.041722:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177664 00000100:00100000:3.0:1788748401.041727:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177664 00000100:00100000:3.0:1788748401.041771:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748401.041779:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:2349:x1875638358177664:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748401.041805:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748401.041829:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7c8b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521816 expref: 15 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748401.041849:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:3.0:1788748401.041855:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748401.041876:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2349:x1875638358177664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 98us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748401.041883:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000040:00080000:0.0:1788748401.453421:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748401.453563:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748401.453611:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788748401.453619:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788748401.777313:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788748402.485010:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:2.0:1788748402.723550:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748402.723599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748402.723609:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358177920 00000100:00100000:2.0:1788748402.723634:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748402.723651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748402.723671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748402.723764:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178176 00000100:00100000:0.0:1788748402.723771:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178176 00000100:00100000:0.0:1788748402.723826:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178304 00000100:00100000:0.0:1788748402.723829:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178304 00000100:00100000:0.0:1788748402.723847:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1788748402.723856:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358178176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748402.723920:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358178176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748402.723942:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1788748402.723972:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788748402.723978:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358178304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1788748402.723979:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748402.723983:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748402.724005:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2347:x1875638358178304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748402.724010:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788748402.724048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178432 00000100:00100000:0.0:1788748402.724052:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178432 00000100:00080000:2.0:1788748402.724107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748402.724130:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178048 00000100:00100000:0.0:1788748402.724133:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178048 00000100:00100000:0.0:1788748402.724162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1788748402.724169:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358178432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748402.724198:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358178432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748402.724203:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1788748402.724215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:0.0:1788748402.724221:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358178048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748402.724258:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358178048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748402.724264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1788748402.725193:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358177920 00000100:00100000:3.0:1788748402.725251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:3.0:1788748402.725260:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358177920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748402.725311:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358177920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748402.725320:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 289 00010000:00010000:0.0:1788748402.798130:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748403.406513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748403.410870:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178560 00000100:00100000:3.0:1788748403.410887:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178560 00000100:00100000:3.0:1788748403.410978:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1788748403.410989:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:11331:x1875638358178560:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748403.411009:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748403.411092:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652181d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411179:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411195:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411238:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411246:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411253:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411511:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411520:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411527:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411533:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748403.411537:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411554:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411565:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748403.411569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748403.411574:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411595:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411608:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411614:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411619:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411625:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748403.411627:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411634:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411641:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cec9769f00) 00010000:00010000:3.0:1788748403.411643:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748403.411646:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411662:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411697:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652181d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411707:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748403.411709:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748403.411713:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652181d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.411722:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e200, rc 0) 00000100:00100000:3.0:1788748403.411789:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:11331:x1875638358178560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 801us (5285us total) trans 0 rc 301/301 00000100:00100000:3.0:1788748403.411797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00080000:2.0:1788748403.412618:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748403.431190:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748403.431288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178816 00000100:00100000:3.0:1788748403.431298:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178816 00000100:00100000:3.0:1788748403.431358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:3.0:1788748403.431369:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:11331:x1875638358178816:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1788748403.431436:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748403.431463:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c24b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652165d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431481:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748403.431491:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748403.431714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431734:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431744:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431758:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431765:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.431771:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748403.432707:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788748403.432719:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432726:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432733:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432739:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748403.432743:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432750:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432772:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:3.0:1788748403.432776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748403.432781:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.432787:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748403.432802:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006c4eb328 reply state 000000004cd2db15 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748403.432810:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748403.432942:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:11331:x1875638358178816:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 1572us (1759us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788748403.432963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00010000:00010000:2.0:1788748403.435322:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435337:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435345:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435360:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748403.435364:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435371:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435386:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cec9769500) 00010000:00010000:2.0:1788748403.435390:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748403.435394:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.435400:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f400/0x5b377f42a7a7c8db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748403.565412:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748403.565498:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358178944 00000100:00100000:3.0:1788748403.565508:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358178944 00000100:00100000:3.0:1788748403.565575:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1788748403.565596:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:11339:x1875638358178944:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:3.0:1788748403.565624:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748403.565646:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521824 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565709:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565723:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565753:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748403.565789:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748403.565792:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748403.565812:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c8e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521824 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565848:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521824 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.565856:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:3.0:1788748403.565858:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748403.565861:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f000, rc 0) 00000100:00100000:3.0:1788748403.565964:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:11339:x1875638358178944:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 370us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748403.565971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1788748403.635285:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748403.635485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179072 00000100:00100000:2.0:1788748403.635497:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179072 00000100:00100000:2.0:1788748403.635570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:2.0:1788748403.635594:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:11345:x1875638358179072:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748403.635651:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748403.635673:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652182b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635735:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635750:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635761:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635774:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635781:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635788:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635897:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635906:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635913:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748403.635963:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788748403.635967:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748403.635987:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.635999:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636005:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636057:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636065:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748403.636070:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636078:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636090:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:2.0:1788748403.636093:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748403.636098:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636104:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7c8f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636117:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636134:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636140:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636146:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748403.636149:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636156:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636165:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cec6646f00) 00010000:00010000:2.0:1788748403.636168:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748403.636171:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636178:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7c8fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636225:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7c8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652182b expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636240:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652182b expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.636248:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748403.636251:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748403.636260:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:2.0:1788748403.636327:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:11345:x1875638358179072:12345-192.168.203.4@tcp:101:bash.0 Request processed in 735us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748403.636335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:2.0:1788748403.643136:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.643213:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179328 00000100:00100000:0.0:1788748403.643226:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179328 00000100:00100000:0.0:1788748403.643278:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:0.0:1788748403.643288:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+15:11345:x1875638358179328:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748403.643321:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748403.643342:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c90c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521832 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643460:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643474:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643485:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643545:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643552:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.643563:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748403.644119:0:8052:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788748403.644273:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644283:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644292:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644333:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644341:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644348:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644353:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748403.644357:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644364:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644374:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748403.644377:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748403.644381:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644387:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7c913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748403.644399:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000bf228fb reply state 0000000020f38c1e transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748403.644406:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788748403.644430:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7c90c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 18 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644452:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 17 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.644460:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748403.644671:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748403.644675:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748403.644794:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:11345:x1875638358179328:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1507us (1665us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788748403.644802:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00010000:00010000:1.0:1788748403.654336:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.654353:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748403.654357:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1788748403.654366:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.654372:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748403.654378:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.654386:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.654401:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09900) 00010000:00010000:1.0:1788748403.654404:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748403.654408:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.654415:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7c91a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748403.654474:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179456 00000100:00100000:0.0:1788748403.654484:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179456 00000100:00100000:0.0:1788748403.654532:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1788748403.654541:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2348:x1875638358179456:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748403.654556:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748403.654571:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521839 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748403.654593:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748403.654609:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1788748403.654614:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748403.654622:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.654638:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.654669:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748403.654719:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358179456:12345-192.168.203.4@tcp:101:bash.0 Request processed in 180us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748403.654726:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788748403.657978:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.658104:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179584 00000100:00100000:0.0:1788748403.658113:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179584 00000100:00100000:0.0:1788748403.658159:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1788748403.658168:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:11345:x1875638358179584:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748403.658185:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748403.658202:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521840 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.658231:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.658240:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748403.658244:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748403.658249:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.658278:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.658291:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 7 pid: 6696 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748403.658321:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875638377059456:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748403.658391:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748403.661978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748403.662094:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179712 00000100:00100000:1.0:1788748403.662103:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179712 00010000:00010000:1.0:1788748403.662138:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 8 pid: 6696 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748403.662177:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:1.0:1788748403.662197:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358179712:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748403.662211:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748403.662232:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 8 pid: 6696 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.662244:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 8 pid: 6696 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.662268:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748403.662272:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748403.662280:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.662290:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.662325:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748403.662350:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377059584:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748403.662407:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7c92f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521839 expref: 8 pid: 6696 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748403.662426:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875638377059456:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748403.662452:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748403.662469:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3cb8f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788748403.662535:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d200, rc 0) 00000100:00100000:0.0:1788748403.662571:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:11345:x1875638358179584:12345-192.168.203.4@tcp:101:bash.0 Request processed in 4402us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748403.662578:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:1.0:1788748403.667516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748403.667644:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb51ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875638377059584:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788748403.667672:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748403.667731:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2348:x1875638358179712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5534us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748403.667741:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788748403.668153:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358179968 00000100:00100000:3.0:1788748403.668161:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358179968 00000100:00100000:3.0:1788748403.668216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788748403.668225:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:11345:x1875638358179968:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:3.0:1788748403.668577:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:11345:x1875638358179968:12345-192.168.203.4@tcp:35:bash.0 Request processed in 352us (1069us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788748403.668596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1788748403.817136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748403.817443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358180224 00000100:00100000:3.0:1788748403.817453:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358180224 00000100:00100000:3.0:1788748403.817512:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:3.0:1788748403.817523:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:11355:x1875638358180224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748403.817547:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748403.817566:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c93d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521847 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748403.817655:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788748403.817758:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c93d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521847 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.817772:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:3.0:1788748403.817775:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748403.817779:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521847 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.817802:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e200, rc 0) 00000100:00100000:3.0:1788748403.817858:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11355:x1875638358180224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 338us (732us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788748403.817865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 143 00010000:00010000:3.0:1788748403.821351:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748403.843514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.843654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358180480 00000100:00100000:0.0:1788748403.843664:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358180480 00000100:00100000:0.0:1788748403.843723:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1788748403.843734:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11355:x1875638358180480:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748403.843976:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11355:x1875638358180480:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 243us (483us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788748403.843984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1788748403.949962:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377059840:0@lo:400:kworker.0 00000100:00100000:0.0:1788748403.949962:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788748403.950037:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377059712:0@lo:400:kworker.0 00000100:00100000:1.0:1788748403.950056:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.950614:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748403.950666:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.950708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748403.950755:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059840 00000100:00100000:3.0:1788748403.950761:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059840 00000100:00100000:3.0:1788748403.950807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788748403.950815:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.950866:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377059840:12345-0@lo:400:kworker.0 Request processed in 52us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748403.950872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788748403.950913:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377059840:0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.951596:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060352 00000100:00100000:3.0:1788748403.951603:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060352 00000100:00100000:3.0:1788748403.951647:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788748403.951655:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.951704:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377060352:12345-0@lo:400:kworker.0 Request processed in 50us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748403.951711:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788748403.951740:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748403.951767:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.952396:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748403.952435:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358180608 00000100:00100000:3.0:1788748403.952441:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358180608 00000100:00100000:3.0:1788748403.952474:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1788748403.952482:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11361:x1875638358180608:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748403.952498:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748403.952517:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c94b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652184e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952608:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952621:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952633:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748403.952666:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788748403.952670:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748403.952687:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7c94b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652184e expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952741:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652184e expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748403.952749:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748403.952751:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748403.952755:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f200, rc 0) 00000100:00100000:3.0:1788748403.952799:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:11361:x1875638358180608:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 318us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748403.952805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:0.0:1788748403.953448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748403.953535:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060096 00000100:00100000:3.0:1788748403.953541:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060096 00000100:00080000:0.0:1788748403.953580:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748403.953588:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788748403.953596:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748403.953649:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377060096:12345-0@lo:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748403.953655:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788748403.953878:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788748403.961958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748403.962033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059712 00000100:00100000:0.0:1788748403.962044:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059712 00000100:00100000:2.0:1788748403.962046:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788748403.962098:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788748403.962108:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377059712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748403.962121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748403.962186:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060224 00000100:00100000:0.0:1788748403.962190:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cede80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377059712:12345-0@lo:400:kworker.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748403.962191:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060224 00000100:00100000:0.0:1788748403.962201:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788748403.962235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788748403.962243:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377060224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788748403.962245:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748403.962670:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377060224:12345-0@lo:400:kworker.0 Request processed in 428us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748403.962679:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788748403.962724:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377059712:0@lo:400:kworker.0 00000100:00100000:2.0:1788748403.962749:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377060224:0@lo:400:kworker.0 00000100:00100000:1.0:1788748403.963444:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748403.964515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.964811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377059968 00000100:00100000:0.0:1788748403.964820:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377059968 00000100:00100000:0.0:1788748403.964885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358180864 00000100:00100000:0.0:1788748403.964889:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358180864 00000100:00100000:0.0:1788748403.964913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788748403.964922:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377059968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748403.965004:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377059968:12345-0@lo:400:kworker.0 Request processed in 83us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748403.965036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788748403.965057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:0.0:1788748403.965064:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:11361:x1875638358180864:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748403.965077:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748403.965095:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521855 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.965199:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7c960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.965213:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7c960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.965238:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7c960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748403.965251:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788748403.965373:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521855 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.965389:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7c960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521855 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.965396:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748403.965399:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748403.965402:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:0.0:1788748403.965449:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11361:x1875638358180864:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 386us (939us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788748403.965455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00080000:2.0:1788748403.965890:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748403.967447:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377059968:0@lo:400:kworker.0 00000100:00100000:2.0:1788748403.974398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748403.974449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.974523:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181120 00000100:00100000:0.0:1788748403.974532:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181120 00000100:00100000:0.0:1788748403.974592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:0.0:1788748403.974603:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11361:x1875638358181120:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748403.974637:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748403.974656:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c96e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652185c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.974750:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.974780:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.974792:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748403.974807:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788748403.974923:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c96e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652185c expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.974951:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652185c expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.974960:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748403.974963:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748403.974966:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:0.0:1788748403.975042:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:11361:x1875638358181120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 441us (654us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788748403.975049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:1.0:1788748403.975963:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181248 00000100:00100000:1.0:1788748403.975971:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181248 00000100:00100000:1.0:1788748403.976051:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1788748403.976060:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:2348:x1875638358181248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748403.976071:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748403.976088:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7c960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521855 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748403.976105:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:1.0:1788748403.976109:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748403.976143:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:2348:x1875638358181248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748403.976149:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748403.987011:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748403.987138:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181376 00000100:00100000:0.0:1788748403.987148:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181376 00000100:00100000:0.0:1788748403.987206:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788748403.987217:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358181376:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1788748403.987263:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.987282:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.987303:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788748403.987307:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748403.987311:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.987358:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748403.987373:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 6 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748403.987387:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875638377060480:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748403.987480:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788748403.996186:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748403.996296:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181504 00000100:00100000:2.0:1788748403.996306:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181504 00002000:00100000:2.0:1788748403.996351:0:6701:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99cf0194ed80 x1875638358181504/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:149/0 lens 504/0 e 0 to 0 dl 1788748414 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748403.996362:0:6701:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cf0194ed80 with x1875638358181504 ext(0->12) 00010000:00010000:2.0:1788748403.996371:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 7 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.996387:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 7 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748403.996395:0:6701:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cf0194ed80 00000100:00100000:2.0:1788748403.996431:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788748403.996440:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358181504:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:2.0:1788748403.996931:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf0194ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2347:x1875638358181504:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 490us (754us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788748403.996950:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:2.0:1788748403.996958:0:6701:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99cf0194ed80 x1875638358181504/t4294967305(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:149/0 lens 504/448 e 0 to 0 dl 1788748414 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748403.996967:0:6701:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cf0194ed80 with x1875638358181504 ext(0->12) 00010000:00010000:2.0:1788748403.996974:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.996993:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748403.997000:0:6701:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cf0194ed80 00000100:00100000:0.0:1788748403.997593:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875638377060480:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748403.997629:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748404.002447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.005821:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181632 00000100:00100000:0.0:1788748404.005834:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181632 00010000:00010000:0.0:1788748404.006318:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.006367:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1788748404.006378:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2349:x1875638358181632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748404.006408:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788748404.006439:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788748404.006443:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788748403 00002000:00010000:0.0:1788748404.006445:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788748403 00002000:00010000:0.0:1788748404.006447:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788748403 00010000:00010000:0.0:1788748404.006453:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.006467:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.006491:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7c936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521840 expref: 9 pid: 6697 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.006510:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748404.006515:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748404.006520:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.006529:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.006560:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748404.006626:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2349:x1875638358181632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 244us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.006633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00010000:00010000:3.0:1788748404.006819:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006830:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006864:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006873:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006881:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006887:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748404.006891:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006900:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006926:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.006934:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000472ec74f/0x5b377f42a7a7c983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748404.006987:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358181376:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 19772us (19985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.006994:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00080000:2.0:1788748404.008774:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748404.009279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.009342:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358181888 00000100:00100000:0.0:1788748404.009350:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358181888 00000100:00100000:0.0:1788748404.009402:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788748404.009412:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11361:x1875638358181888:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:0.0:1788748404.009479:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652185c expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748404.009716:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788748404.009758:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788748404.011328:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1788748404.011409:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.011531:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 28 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.011542:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.011579:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 28 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.011595:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 28 pid: 8052 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.011609:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377060608:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748404.011761:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748404.023126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748404.023206:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358182016 00000100:00100000:3.0:1788748404.023215:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358182016 00010000:00010000:3.0:1788748404.023253:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 29 pid: 8052 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748404.023294:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1788748404.023303:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:2348:x1875638358182016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748404.023318:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748404.023325:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 29 pid: 8052 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.023348:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 29 pid: 8052 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.023369:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:3.0:1788748404.023374:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.023395:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.023403:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.023430:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748404.023488:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:2348:x1875638358182016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 186us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.023496:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00010000:00010000:0.0:1788748404.023646:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7c921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521832 expref: 28 pid: 8052 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.023674:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377060608:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748404.023693:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.023702:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.023708:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748404.023823:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1788748404.024174:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788748404.024276:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377060736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748404.024319:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748404.024518:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.029732:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060736 00000100:00100000:2.0:1788748404.029748:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060736 00000100:00100000:2.0:1788748404.029901:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748404.029913:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377060736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748404.030074:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377060736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.030082:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748404.030178:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377060736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788748404.030730:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788748404.030806:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5225c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377060864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788748404.030845:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.042767:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3cb8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.043081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060864 00000100:00100000:0.0:1788748404.043090:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060864 00000100:00100000:0.0:1788748404.043143:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748404.043151:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377060864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748404.043597:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875638377060864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 445us (12750us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788748404.043606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748404.043792:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5225c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377060864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788748404.044004:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788748404.044214:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044243:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044250:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044256:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748404.044261:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044268:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044284:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:1.0:1788748404.044287:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788748404.044292:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.044298:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c98a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748404.044715:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788748404.045113:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788748404.045126:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321088110649ns, next at 322088108739ns, rc = 0 00000001:00080000:1.0:1788748404.045134:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788748404.045176:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09f00) 00010000:00010000:1.0:1788748404.045180:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788748404.045187:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652185c expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748404.045521:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:11361:x1875638358181888:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 36108us (36243us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788748404.045532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000020:00080000:1.0:1788748404.045538:0:5848:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788748404.057191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.059565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358182144 00000100:00100000:0.0:1788748404.059580:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358182144 00000100:00100000:0.0:1788748404.060318:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:0.0:1788748404.060331:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:11361:x1875638358182144:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748404.060379:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.060401:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7c991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521863 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.060471:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7c991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521863 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.060485:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7c991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521863 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.060503:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.060507:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748404.060510:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d200, rc 0) 00000100:00100000:0.0:1788748404.060576:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11361:x1875638358182144:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 248us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.060582:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:3.0:1788748404.067935:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748404.068061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358182400 00000100:00100000:1.0:1788748404.068072:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358182400 00000100:00100000:1.0:1788748404.068131:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748404.068142:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11361:x1875638358182400:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748404.068376:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:11361:x1875638358182400:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 234us (447us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788748404.068383:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748404.206539:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.206697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358182656 00000100:00100000:0.0:1788748404.206707:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358182656 00000100:00100000:0.0:1788748404.206765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00100000:0.0:1788748404.206774:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:11371:x1875638358182656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748404.206796:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.206814:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652186a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748404.207261:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788748404.207379:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c998 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652186a expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.207411:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:0.0:1788748404.207414:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748404.207420:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652186a expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.207435:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:0.0:1788748404.207507:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11371:x1875638358182656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 733us (977us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1788748404.207514:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00100000:2.0:1788748404.217713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.217823:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358182784 00000100:00100000:0.0:1788748404.217833:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358182784 00000100:00100000:0.0:1788748404.217891:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:0.0:1788748404.217901:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11371:x1875638358182784:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788748404.217980:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.217998:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218010:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218053:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218061:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218086:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218173:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218182:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218189:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748404.218228:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218241:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218248:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218254:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218260:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748404.218264:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218271:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218282:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748404.218290:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748404.218295:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218302:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7c9a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218316:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218321:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218327:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218332:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748404.218335:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218341:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218348:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09200) 00010000:00010000:0.0:1788748404.218351:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748404.218353:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218359:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218376:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218388:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218394:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218399:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748404.218402:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218407:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218430:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.218433:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748404.218436:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.218441:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.218518:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11371:x1875638358182784:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 619us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.218526:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:3.0:1788748404.225963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748404.226064:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358183040 00000100:00100000:1.0:1788748404.226074:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358183040 00000100:00100000:1.0:1788748404.226132:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1788748404.226142:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11371:x1875638358183040:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748404.226523:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:11371:x1875638358183040:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 380us (566us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788748404.226532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1788748404.298830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748404.299691:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358183296 00000100:00100000:2.0:1788748404.299702:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358183296 00000100:00100000:2.0:1788748404.299771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:2.0:1788748404.299784:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:11374:x1875638358183296:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748404.299810:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748404.299830:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c9bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521871 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299905:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299932:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299980:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.299995:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300147:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300156:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300164:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748404.300174:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788748404.300272:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300280:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300287:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300293:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748404.300304:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300313:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300327:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748404.300330:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748404.300569:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300578:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300593:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300600:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300606:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300612:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748404.300615:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300621:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300629:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec6646f00) 00010000:00010000:2.0:1788748404.300632:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748404.300643:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300649:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7c9c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7c9bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300711:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.300719:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748404.300721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748404.300724:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748404.300849:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11374:x1875638358183296:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1067us (2026us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788748404.300857:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:2.0:1788748404.325426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.325488:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358183424 00000100:00100000:0.0:1788748404.325498:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358183424 00000100:00100000:0.0:1788748404.325558:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:0.0:1788748404.325568:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11374:x1875638358183424:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788748404.325637:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325678:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325690:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325720:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325727:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325734:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325740:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748404.325744:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325750:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325761:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.325764:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748404.325768:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.325774:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.325851:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11374:x1875638358183424:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 284us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.325865:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:2.0:1788748404.331700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748404.331800:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358183680 00000100:00100000:3.0:1788748404.331810:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358183680 00000100:00100000:3.0:1788748404.331894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1788748404.331903:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11374:x1875638358183680:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748404.332170:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:11374:x1875638358183680:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 267us (478us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788748404.332178:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1788748404.462341:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377060992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748404.462421:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748404.462564:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377060992 00000100:00100000:0.0:1788748404.462572:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377060992 00000100:00100000:0.0:1788748404.462632:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748404.462642:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377060992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748404.462673:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748404.472363:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377060992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9710us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.472442:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748404.472479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377060992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748404.643184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.643829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358183936 00000100:00100000:0.0:1788748404.643840:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358183936 00000100:00100000:0.0:1788748404.643906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:0.0:1788748404.643916:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:11405:x1875638358183936:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748404.643949:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.643973:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521878 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.644109:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.644124:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.644136:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748404.644147:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788748404.644276:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7c9e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521878 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.644307:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521878 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.644315:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.644318:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748404.644321:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d600, rc 0) 00000100:00100000:0.0:1788748404.644448:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11405:x1875638358183936:12345-192.168.203.4@tcp:101:cat.0 Request processed in 533us (1271us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788748404.644455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:2.0:1788748404.658525:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.658702:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358184064 00000100:00100000:0.0:1788748404.658712:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358184064 00000100:00100000:0.0:1788748404.658827:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748404.658838:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:2349:x1875638358184064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748404.658854:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748404.658877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7c9ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521878 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.658898:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.658911:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748404.658981:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:2349:x1875638358184064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.658988:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788748404.662097:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748404.662190:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358184320 00000100:00100000:1.0:1788748404.662200:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358184320 00000100:00100000:1.0:1788748404.662257:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788748404.662268:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:11405:x1875638358184320:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:1.0:1788748404.662786:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11405:x1875638358184320:12345-192.168.203.4@tcp:35:cat.0 Request processed in 518us (695us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788748404.662795:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1788748404.735696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748404.735775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358184576 00000100:00100000:2.0:1788748404.735783:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358184576 00000100:00100000:2.0:1788748404.735830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:2.0:1788748404.735840:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11411:x1875638358184576:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788748404.735865:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748404.735870:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788748404.735896:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7c952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652184e expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.735926:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748404.735930:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748404.735953:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652187f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.736126:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.736141:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.736149:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.736190:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.736203:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 40 pid: 5844 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748404.736216:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb80a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377061120:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748404.736302:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.740524:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748404.740681:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358184704 00000100:00100000:3.0:1788748404.740690:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358184704 00010000:00010000:3.0:1788748404.740729:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 41 pid: 5844 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748404.740874:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788748404.740898:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed422850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+41:2348:x1875638358184704:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748404.740914:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788748404.740922:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb80a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377061120:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748404.740924:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 41 pid: 5844 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.740957:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741111:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 41 pid: 5844 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741131:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7c9d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521871 expref: 41 pid: 5844 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741141:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748404.741145:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741151:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741156:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.741249:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748404.741494:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.741500:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748404.741525:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788748404.741667:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7c9fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.741678:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.741683:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748404.741685:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748404.741687:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2800, rc 0) 00000100:00100000:0.0:1788748404.741868:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+41:11411:x1875638358184576:12345-192.168.203.4@tcp:101:dd.0 Request processed in 6031us (6179us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788748404.741874:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed422850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+41:2348:x1875638358184704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 976us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.741885:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1788748404.742169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:2.0:1788748404.749146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748404.749242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358184960 00000100:00100000:0.0:1788748404.749253:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358184960 00000100:00100000:0.0:1788748404.749345:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:0.0:1788748404.749356:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11411:x1875638358184960:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1788748404.749607:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.749623:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.749645:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748404.749692:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1788748404.749715:0:5846:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a3ddec2b reply state 00000000271143cc transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748404.749723:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748404.749807:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:11411:x1875638358184960:12345-192.168.203.4@tcp:36:dd.0 Request processed in 453us (669us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788748404.749814:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 154 00000020:00080000:0.0:1788748404.749819:0:5846:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788748404.752074:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752093:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752116:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752121:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748404.752124:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752133:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752150:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748404.752153:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748404.752158:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.752230:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.847155:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748404.980884:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748404.980906:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377061248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748404.980984:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748404.981288:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377061248 00000100:00100000:0.0:1788748404.981297:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377061248 00000100:00100000:0.0:1788748404.981351:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788748404.981361:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377061248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748404.981396:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748404.981454:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377061248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.981461:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788748404.981907:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377061248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748405.061150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.061331:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358185088 00000100:00100000:0.0:1788748405.061355:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358185088 00000100:00100000:0.0:1788748405.061464:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:0.0:1788748405.061475:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+42:11425:x1875638358185088:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:0.0:1788748405.061506:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.061536:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521886 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061652:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061670:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061685:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061703:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061711:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061719:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061843:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061855:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061865:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061910:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.061949:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 43 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748405.061966:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377061376:192.168.203.4@tcp:104: 00000100:00080000:2.0:1788748405.062613:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748405.062698:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788748405.066240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748405.066606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358185344 00000100:00100000:3.0:1788748405.066620:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358185344 00000100:00100000:3.0:1788748405.066695:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748405.066727:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:6050:x1875638358185344:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788748405.067232:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:6050:x1875638358185344:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 507us (1005us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788748405.067242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788748405.067782:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377061376:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748405.067816:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.076248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748405.076393:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358185472 00000100:00100000:2.0:1788748405.076418:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358185472 00010000:00010000:2.0:1788748405.076475:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 45 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748405.076531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1788748405.076543:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:2348:x1875638358185472:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748405.076583:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748405.076591:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 45 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076607:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 45 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076633:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652187f expref: 45 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076653:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748405.076659:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076671:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076682:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.076724:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748405.076798:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:2348:x1875638358185472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 256us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748405.076807:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00010000:00010000:1.0:1788748405.077063:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077073:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748405.077134:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788748405.077139:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748405.077168:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077183:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077192:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077199:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077213:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077220:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.077225:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077234:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077244:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748405.077248:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748405.077252:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077259:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077273:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077280:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077286:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077291:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.077295:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077314:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077324:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09200) 00010000:00010000:1.0:1788748405.077326:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748405.077330:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077335:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077384:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521886 expref: 44 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077399:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521886 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.077405:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.077407:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748405.077410:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d600, rc 0) 00000100:00100000:1.0:1788748405.077452:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:11425:x1875638358185088:12345-192.168.203.4@tcp:101:stat.0 Request processed in 15979us (16317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.077460:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:1.0:1788748405.169628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748405.169745:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358185728 00000100:00100000:2.0:1788748405.169758:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358185728 00000100:00100000:2.0:1788748405.169838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:2.0:1788748405.169851:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:11431:x1875638358185728:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:2.0:1788748405.169965:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748405.170001:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521886 expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.170055:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748405.170060:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748405.170573:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.170590:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.170603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748405.170657:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1788748405.170681:0:5844:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000aed49d59 reply state 00000000b83f5f8a transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748405.170690:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748405.170811:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:11431:x1875638358185728:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 961us (1195us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1788748405.170823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000020:00080000:2.0:1788748405.170829:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788748405.175086:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175110:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175138:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175145:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.175150:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175295:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175319:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.175323:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748405.175330:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.175337:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7ca32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.367244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.367441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358185856 00000100:00100000:0.0:1788748405.367455:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358185856 00000100:00100000:0.0:1788748405.367528:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:0.0:1788748405.367540:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:11446:x1875638358185856:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:0.0:1788748405.367574:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.367611:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652188d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367726:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367744:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367758:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367775:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367808:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367921:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367931:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.367950:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748405.367996:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788748405.368001:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748405.368068:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368082:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368092:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368452:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368461:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368481:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.368486:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368494:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368510:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748405.368514:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.368520:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368526:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ca40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368546:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368552:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368558:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368563:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.368566:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368572:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368604:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09600) 00010000:00010000:0.0:1788748405.368607:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.368610:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368616:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368662:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368678:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.368686:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.368689:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748405.368691:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:0.0:1788748405.368783:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:11446:x1875638358185856:12345-192.168.203.4@tcp:101:stat.0 Request processed in 1243us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748405.368791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:2.0:1788748405.463764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.464186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358186112 00000100:00100000:0.0:1788748405.464199:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358186112 00000100:00100000:0.0:1788748405.464646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:0.0:1788748405.464664:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+45:11456:x1875638358186112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748405.464691:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.464717:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521894 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748405.464859:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788748405.465066:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521894 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.465093:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:0.0:1788748405.465096:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748405.465102:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521894 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.465120:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d600, rc 0) 00000100:00100000:0.0:1788748405.465202:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:11456:x1875638358186112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 544us (1450us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1788748405.465210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:3.0:1788748405.472734:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.472915:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358186368 00000100:00100000:1.0:1788748405.472929:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358186368 00000100:00100000:1.0:1788748405.473009:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788748405.473059:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+46:11456:x1875638358186368:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748405.474777:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:11456:x1875638358186368:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1709us (2045us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788748405.474791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788748405.527248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.527656:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358186624 00000100:00100000:0.0:1788748405.527672:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358186624 00000100:00100000:0.0:1788748405.527841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:0.0:1788748405.527853:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+47:11462:x1875638358186624:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748405.528601:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.528633:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652189b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.529278:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.529304:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.530480:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.530547:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.530568:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 48 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748405.530587:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377061504:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748405.530740:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748405.543339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.543489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358186752 00000100:00100000:1.0:1788748405.544548:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358186752 00010000:00010000:1.0:1788748405.544805:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 49 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.544874:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1788748405.544888:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:2348:x1875638358186752:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748405.544911:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748405.544919:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 49 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.544948:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 49 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.544975:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.544981:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.544993:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.545002:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.545050:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748405.545135:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+49:2348:x1875638358186752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 250us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.545143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:0.0:1788748405.549626:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652188d expref: 48 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748405.549688:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cec2c15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377061504:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748405.549731:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.549745:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.549752:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748405.549783:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788748405.554554:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7ca63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.554618:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.554628:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.554631:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748405.554634:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:0.0:1788748405.554715:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:11462:x1875638358186624:12345-192.168.203.4@tcp:101:bash.0 Request processed in 26864us (27481us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788748405.554723:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:2.0:1788748405.562446:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.562724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187008 00000100:00100000:0.0:1788748405.562739:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187008 00000100:00100000:0.0:1788748405.562814:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:0.0:1788748405.562826:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:11462:x1875638358187008:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1788748405.563224:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.563247:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.563262:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748405.563324:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1788748405.563364:0:5844:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004840f5fe reply state 0000000003af4c9b transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748405.563374:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748405.564781:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:11462:x1875638358187008:12345-192.168.203.4@tcp:36:bash.0 Request processed in 1946us (2338us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788748405.564795:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000020:00080000:0.0:1788748405.564802:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788748405.571678:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571700:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571710:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571717:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.571723:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571732:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571753:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.571757:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.571763:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.571770:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748405.572478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.572596:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187136 00000100:00100000:1.0:1788748405.572610:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187136 00000100:00100000:1.0:1788748405.572879:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1788748405.572892:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:11462:x1875638358187136:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748405.572921:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748405.572958:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7ca7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218a2 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.573077:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.573095:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.573105:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.573145:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.573160:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 51 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.573177:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377061632:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748405.573866:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788748405.578239:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377061632:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748405.578280:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748405.578967:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.579693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187264 00000100:00100000:1.0:1788748405.579721:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187264 00010000:00010000:1.0:1788748405.579764:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 52 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.579851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1788748405.579860:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:2348:x1875638358187264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748405.579877:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748405.579883:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 52 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.579904:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 52 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.579926:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ca6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652189b expref: 52 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.579954:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.579960:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.579969:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.579976:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.580005:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748405.580077:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:2348:x1875638358187264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.580090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00010000:00010000:2.0:1788748405.580709:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.580732:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748405.580797:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788748405.580803:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748405.580830:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.580875:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7ca7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218a2 expref: 51 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.580895:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218a2 expref: 50 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.580904:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748405.580907:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748405.580911:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:2.0:1788748405.580983:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:11462:x1875638358187136:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8094us (8511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748405.580991:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:2.0:1788748405.587291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.587569:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187520 00000100:00100000:1.0:1788748405.587582:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187520 00000100:00100000:1.0:1788748405.587641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748405.587652:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:11462:x1875638358187520:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1788748405.587924:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:11462:x1875638358187520:12345-192.168.203.4@tcp:35:bash.0 Request processed in 273us (646us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788748405.587943:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:0.0:1788748405.676217:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748405.676323:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187776 00000100:00100000:2.0:1788748405.676340:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187776 00000100:00100000:2.0:1788748405.676424:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788748405.676437:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:11472:x1875638358187776:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748405.676461:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748405.676481:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ca8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218a9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748405.676613:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788748405.676730:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ca8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218a9 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.676744:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:2.0:1788748405.676747:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748405.676753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ca8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218a9 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.676768:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748405.676840:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11472:x1875638358187776:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 405us (637us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1788748405.676847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1788748405.681688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.687200:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358187904 00000100:00100000:0.0:1788748405.687222:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358187904 00000100:00100000:0.0:1788748405.687325:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:0.0:1788748405.687340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11472:x1875638358187904:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1788748405.687471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687492:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687507:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687523:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687530:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687537:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687659:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687667:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687675:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748405.687733:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687749:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687767:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687774:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687781:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.687785:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687794:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687808:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748405.687812:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.687818:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687824:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ca9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687842:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687849:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687854:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687860:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.687870:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687877:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687886:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09600) 00010000:00010000:0.0:1788748405.687889:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.687892:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687898:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7caa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687938:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687945:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687951:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687957:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.687960:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687966:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687973:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.687975:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.687988:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.687994:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7caa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748405.688212:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11472:x1875638358187904:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 874us (6531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748405.688222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:1.0:1788748405.692836:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748405.693107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358188160 00000100:00100000:3.0:1788748405.693117:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358188160 00000100:00100000:3.0:1788748405.693161:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788748405.693170:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11472:x1875638358188160:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748405.693395:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:11472:x1875638358188160:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 224us (566us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788748405.693411:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:2.0:1788748405.753845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.754520:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358188416 00000100:00100000:0.0:1788748405.754540:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358188416 00000100:00100000:0.0:1788748405.754626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:0.0:1788748405.754639:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+53:11476:x1875638358188416:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748405.754672:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.754699:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218b0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754794:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754812:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754826:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754844:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754851:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.754880:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755108:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755118:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755127:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748405.755139:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788748405.755265:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755272:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755279:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755300:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.755305:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755314:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755330:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748405.755334:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.755350:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755357:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755374:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755380:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755386:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755392:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748405.755395:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755400:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755407:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09600) 00010000:00010000:0.0:1788748405.755410:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748405.755412:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.755418:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cabe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.755578:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b0 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.755611:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b0 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.755621:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.755624:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748405.755629:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:1.0:1788748405.755708:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11476:x1875638358188416:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1070us (1871us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788748405.755717:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:2.0:1788748405.768208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748405.768260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748405.768344:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358188672 00000100:00100000:3.0:1788748405.768354:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358188672 00000100:00100000:3.0:1788748405.768424:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788748405.768434:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:2347:x1875638358188672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748405.768450:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748405.768472:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b0 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748405.768494:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748405.768499:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748405.768564:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:2347:x1875638358188672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748405.768572:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748405.768924:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358188544 00000100:00100000:1.0:1788748405.768938:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358188544 00000100:00100000:1.0:1788748405.768984:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:1.0:1788748405.768992:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11476:x1875638358188544:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1788748405.769106:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769120:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769130:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769157:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769163:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769170:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769175:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.769179:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769187:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769197:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748405.769201:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748405.769206:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.769213:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748405.769286:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11476:x1875638358188544:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 295us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.769293:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:2.0:1788748405.772812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748405.772918:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358188928 00000100:00100000:3.0:1788748405.772927:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358188928 00000100:00100000:3.0:1788748405.773009:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1788748405.773052:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11476:x1875638358188928:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748405.773258:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11476:x1875638358188928:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 209us (454us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788748405.773265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00010000:00010000:0.0:1788748405.869242:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748405.883217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.883385:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358189184 00000100:00100000:0.0:1788748405.883395:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358189184 00000100:00100000:0.0:1788748405.883469:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:0.0:1788748405.883480:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11494:x1875638358189184:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748405.883505:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748405.883531:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cada lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218b7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.883629:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cae1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.883642:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.883667:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748405.883680:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788748405.883806:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cada lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b7 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.883826:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cae1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b7 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.883833:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.883836:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788748405.883839:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:0.0:1788748405.883899:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11494:x1875638358189184:12345-192.168.203.4@tcp:101:cat.0 Request processed in 421us (691us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788748405.883907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:0.0:1788748405.931989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.932195:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358189312 00000100:00100000:1.0:1788748405.932206:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358189312 00000100:00100000:1.0:1788748405.932259:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:1.0:1788748405.932270:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11495:x1875638358189312:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748405.932294:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748405.932315:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7caef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218be expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932383:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932396:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932407:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748405.932441:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788748405.932445:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748405.932462:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932486:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7caef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218be expref: 59 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932510:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218be expref: 58 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.932526:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748405.932529:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748405.932533:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9a00, rc 0) 00000100:00100000:1.0:1788748405.932585:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11495:x1875638358189312:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 317us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.932592:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1788748405.942190:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748405.943040:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358189696 00000100:00100000:3.0:1788748405.943056:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358189696 00000100:00100000:3.0:1788748405.943142:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1788748405.943155:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11495:x1875638358189696:12345-192.168.203.4@tcp:35:lfs.0 00000001:00080000:3.0:1788748405.943960:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967457 00000100:00100000:3.0:1788748405.944172:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11495:x1875638358189696:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1009us (1985us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788748405.944183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000020:00080000:3.0:1788748405.944190:0:5848:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788748405.947469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748405.947754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358189824 00000100:00100000:0.0:1788748405.947768:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358189824 00000100:00100000:0.0:1788748405.947920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788748405.947945:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11495:x1875638358189824:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:0.0:1788748405.947967:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788748405.948003:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7ca86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218a2 expref: 60 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.948065:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218b7 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.948083:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7c991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521863 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748405.948094:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748405.948118:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748405.948203:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11495:x1875638358189824:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 272us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748405.948211:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788748405.952817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748405.952893:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358189952 00000100:00100000:2.0:1788748405.952909:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358189952 00000100:00100000:2.0:1788748405.953002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:2.0:1788748405.953033:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11495:x1875638358189952:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:2.0:1788748405.953181:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.953218:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748405.953233:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748405.953508:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788748405.953622:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11495:x1875638358189952:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 609us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748405.953632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:2.0:1788748405.989378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748405.989467:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190080 00000100:00100000:1.0:1788748405.989480:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190080 00000100:00100000:1.0:1788748405.989555:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1788748405.989566:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11497:x1875638358190080:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748405.989595:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748405.989623:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cb04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218c5 expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989715:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989733:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989749:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989767:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989774:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989808:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989941:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989951:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.989959:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748405.990005:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788748405.990010:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748405.990086:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990100:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990109:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990115:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990121:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990127:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.990132:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990146:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990166:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748405.990169:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748405.990175:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990181:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cb0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990197:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990203:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990209:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990214:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748405.990217:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990222:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990229:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cecfaeff00) 00010000:00010000:1.0:1788748405.990231:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748405.990234:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990250:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cb12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990290:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cb04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 59 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990304:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 58 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748405.990311:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748405.990314:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748405.990316:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8a00, rc 0) 00000100:00100000:1.0:1788748405.990394:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11497:x1875638358190080:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 828us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.990403:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000040:00080000:1.0:1788748406.576135:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748406.576147:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748406.576193:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788748406.576201:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748406.576363:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7314a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377061760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748406.576872:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748406.586312:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.586440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190208 00000100:00100000:1.0:1788748406.586452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190208 00000100:00100000:1.0:1788748406.586539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:1.0:1788748406.586559:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190208:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748406.586603:0:5844:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748406.586974:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190208:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 422us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748406.586983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:0.0:1788748406.589085:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7314a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377061760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748406.595127:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748406.595309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190336 00000100:00100000:0.0:1788748406.595323:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190336 00000100:00100000:0.0:1788748406.595409:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:0.0:1788748406.595423:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11508:x1875638358190336:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788748406.595544:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595592:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595609:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595629:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595637:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595643:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595679:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595936:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.595947:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748406.596000:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788748406.596005:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748406.596060:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596075:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596096:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596104:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596111:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748406.596116:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596125:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596140:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:0.0:1788748406.596144:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748406.596150:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596174:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596181:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596187:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596192:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748406.596201:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596207:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596215:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99cec3e09100) 00010000:00010000:0.0:1788748406.596217:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748406.596220:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596226:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596244:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596249:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596255:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748406.596263:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596268:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:0.0:1788748406.596277:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748406.596287:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.596293:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cb2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748406.596392:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11508:x1875638358190336:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 970us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748406.596400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:1.0:1788748406.601507:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.607740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190592 00000100:00100000:3.0:1788748406.607762:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190592 00000100:00100000:3.0:1788748406.607851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:3.0:1788748406.607864:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11508:x1875638358190592:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.607893:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748406.607919:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cb35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218cc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608237:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608273:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608289:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748406.608305:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788748406.608429:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608438:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608446:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608452:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748406.608457:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608465:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608479:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:3.0:1788748406.608483:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748406.608645:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608656:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608780:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cb35 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218cc expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608800:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:3.0:1788748406.608802:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748406.608807:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cb35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218cc expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.608817:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e200, rc 0) 00000100:00100000:3.0:1788748406.611329:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190592:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3451us (9835us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788748406.611345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:3.0:1788748406.624081:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.624192:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190720 00000100:00100000:1.0:1788748406.624206:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190720 00000100:00100000:1.0:1788748406.624282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:1.0:1788748406.624295:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190720:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748406.624346:0:5845:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748406.624480:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190720:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 187us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748406.624499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:0.0:1788748406.629470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.633574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358190976 00000100:00100000:3.0:1788748406.633596:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358190976 00000100:00100000:3.0:1788748406.633709:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:3.0:1788748406.633722:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec2c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358190976:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.633751:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748406.633755:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788748406.633790:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7caf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218be expref: 59 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.633810:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748406.633817:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748406.633834:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218d3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748406.634400:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788748406.634671:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cb51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.634689:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.634705:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.634778:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218d3 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.634800:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cb51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218d3 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.634808:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec9769500) 00010000:00010000:3.0:1788748406.634811:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748406.634814:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ec00, rc 0) 00000100:00100000:3.0:1788748406.634909:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec2c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11508:x1875638358190976:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1189us (5449us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788748406.634917:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:0.0:1788748406.650556:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.650889:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358191232 00000100:00100000:3.0:1788748406.650905:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358191232 00000100:00100000:3.0:1788748406.650998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:3.0:1788748406.651048:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11508:x1875638358191232:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.651133:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748406.651172:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cb51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218d3 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.651219:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec9769500) 00010000:00010000:3.0:1788748406.651235:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748406.651268:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.651286:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.651299:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657033:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657058:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657072:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657149:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657157:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657164:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657170:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748406.657175:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657197:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657210:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748406.657214:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748406.657219:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657225:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cb5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657240:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657246:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657252:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657257:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748406.657260:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657266:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.657273:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf8f881e7 (ffff99cec9769c00) 00010000:00010000:3.0:1788748406.660268:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748406.660297:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.660331:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf8f881e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.660456:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358191232:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 9445us (9910us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788748406.660465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:3.0:1788748406.664100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748406.664173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358191360 00000100:00100000:0.0:1788748406.664190:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358191360 00000100:00100000:0.0:1788748406.664276:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:0.0:1788748406.664288:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11508:x1875638358191360:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748406.664316:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748406.664357:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218da expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664412:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664430:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664445:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664859:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cb6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664901:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.664910:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748406.664913:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748406.664918:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:0.0:1788748406.665118:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11508:x1875638358191360:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 832us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748406.665127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:0.0:1788748406.675712:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.675789:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358191616 00000100:00100000:3.0:1788748406.675800:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358191616 00000100:00100000:3.0:1788748406.675856:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:3.0:1788748406.675866:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11508:x1875638358191616:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.675973:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.675991:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.676004:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748406.676369:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788748406.676380:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323719364858ns, next at 324719361891ns, rc = 0 00000004:00010000:3.0:1788748406.676464:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008af74912 reply state 0000000040a7d4b4 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.676474:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748406.676571:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11508:x1875638358191616:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 705us (868us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788748406.676592:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:1.0:1788748406.688938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.688995:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358191744 00010000:00010000:3.0:1788748406.688998:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748406.689008:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358191744 00010000:00010000:3.0:1788748406.689039:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.689048:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.689054:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748406.689059:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.689066:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.689084:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748406.689087:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748406.689092:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.689098:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cb7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748406.689114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:1.0:1788748406.689129:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11508:x1875638358191744:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748406.689161:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748406.689185:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218e1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.689263:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.689280:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.689326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748406.689329:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748406.689333:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9600, rc 0) 00000100:00100000:1.0:1788748406.689413:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11508:x1875638358191744:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 287us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748406.689421:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:0.0:1788748406.696135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.696222:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358191872 00000100:00100000:1.0:1788748406.696237:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358191872 00000100:00100000:1.0:1788748406.696342:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788748406.696354:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358191872:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788748406.696400:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748406.696993:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358191872:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 638us (865us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788748406.697005:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788748406.711164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.711627:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358192128 00000100:00100000:1.0:1788748406.711637:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358192128 00000100:00100000:1.0:1788748406.711692:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1788748406.711703:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11508:x1875638358192128:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748406.711960:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+63:11508:x1875638358192128:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 257us (804us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788748406.711968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788748406.714618:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.714717:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358192384 00000100:00100000:3.0:1788748406.714726:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358192384 00000100:00100000:3.0:1788748406.714795:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:3.0:1788748406.714806:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+63:11508:x1875638358192384:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748406.715108:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+63:11508:x1875638358192384:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 303us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.715116:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1788748406.722124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.722994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358192512 00000100:00100000:1.0:1788748406.723005:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358192512 00000100:00100000:1.0:1788748406.723076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:1.0:1788748406.723086:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+63:11508:x1875638358192512:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748406.723117:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748406.723136:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cb89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218e8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723202:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723228:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748406.723273:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748406.723292:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723317:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cb89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e8 expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723332:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e8 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.723340:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748406.723343:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788748406.723346:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8200, rc 0) 00000100:00100000:1.0:1788748406.723407:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11508:x1875638358192512:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 322us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748406.723415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:0.0:1788748406.736828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.737044:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358192640 00000100:00100000:3.0:1788748406.737055:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358192640 00000100:00100000:3.0:1788748406.737107:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788748406.737117:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358192640:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.737136:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748406.737156:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218ef expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748406.737183:0:8053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e2276, blocks: 0x1 00010000:00010000:3.0:1788748406.737204:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1788748406.737210:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748406.737219:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 8 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.737239:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 8 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.737264:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f800, rc 0) 00000100:00100000:3.0:1788748406.737327:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358192640:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 211us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.737334:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1788748406.745478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.746417:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358192896 00000100:00100000:3.0:1788748406.746440:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358192896 00000100:00100000:3.0:1788748406.746503:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:3.0:1788748406.746514:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11508:x1875638358192896:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748406.746618:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11508:x1875638358192896:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 106us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.746625:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:1.0:1788748406.764655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.765707:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193024 00000100:00100000:3.0:1788748406.765720:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193024 00000100:00100000:3.0:1788748406.765780:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788748406.765791:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:11508:x1875638358193024:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.765809:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748406.765827:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218f6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.765859:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 9 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.765869:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748406.765883:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748406.765889:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.765932:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 9 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.765947:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 9 pid: 8053 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.765972:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377061888:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748406.766079:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cdc4d56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748406.774283:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748406.774407:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193152 00000100:00100000:1.0:1788748406.774417:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193152 00010000:00010000:1.0:1788748406.774461:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 10 pid: 8053 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748406.774507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1788748406.774517:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358193152:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748406.774533:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748406.774555:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 10 pid: 8053 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.774569:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 10 pid: 8053 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.774595:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748406.774599:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748406.774608:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.774619:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.774658:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748406.774673:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875638377062016:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748406.774759:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea62780 going to sleep for 11 seconds 00010000:00010000:3.0:1788748406.775197:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7cb97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218ef expref: 10 pid: 8053 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.775212:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377061888:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748406.775236:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.775256:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fa00, rc 0) 00000100:00100000:3.0:1788748406.775295:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:11508:x1875638358193024:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 9505us (10648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.775302:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1788748406.790172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748406.790229:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875638377062016:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788748406.790256:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748406.790306:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358193152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 15790us (16031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748406.790316:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1788748406.790358:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193280 00000100:00100000:2.0:1788748406.790365:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193280 00002000:00100000:2.0:1788748406.790407:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99cef7256d80 x1875638358193280/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:152/0 lens 504/0 e 0 to 0 dl 1788748417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748406.790418:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7256d80 with x1875638358193280 ext(0->8) 00002000:00010000:2.0:1788748406.790424:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cef7256d80 00000100:00100000:2.0:1788748406.790446:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748406.790455:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358193280:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788748406.790863:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2347:x1875638358193280:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 407us (698us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788748406.790871:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00002000:00100000:2.0:1788748406.790877:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99cef7256d80 x1875638358193280/t4294967314(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:152/0 lens 504/448 e 0 to 0 dl 1788748417 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748406.790885:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7256d80 with x1875638358193280 ext(0->8) 00002000:00010000:2.0:1788748406.790889:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cef7256d80 00000100:00100000:3.0:1788748406.795324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748406.795478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193408 00000100:00100000:2.0:1788748406.795489:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193408 00000100:00100000:2.0:1788748406.795556:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:2.0:1788748406.795566:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11508:x1875638358193408:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788748406.885495:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11508:x1875638358193408:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 89921us (90175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748406.885510:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000001:00080000:3.0:1788748406.885818:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1788748406.885860:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788748406.885876:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788748406.885896:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cec3cb8a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788748406.885900:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ceecdc0900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cec3cb8d80 00000020:00080000:3.0:1788748406.885903:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ceecdc0400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cefb57e800 00000004:00080000:3.0:1788748406.885987:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788748406.886042:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788748406.886232:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788748406.886441:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ced2ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377062144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788748406.886489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748406.886587:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377062144 00000100:00100000:1.0:1788748406.886595:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377062144 00000100:00100000:1.0:1788748406.886649:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748406.886659:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377062144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788748406.886800:0:8053:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788748406.886804:0:8053:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788748406 00002000:00010000:1.0:1788748406.886807:0:8053:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788748406.886809:0:8053:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788748406 -> 1788748406 00002000:00010000:1.0:1788748406.886811:0:8053:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788748406.886857:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875638377062144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (367us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788748406.886865:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1788748406.886915:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ced2ad4e00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788748406.886932:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ced2ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377062144:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788748406.887247:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748406.887492:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748406.887504:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377062272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748406.887537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748406.887662:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377062272 00000100:00100000:0.0:1788748406.887668:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377062272 00000100:00100000:0.0:1788748406.887806:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748406.887816:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875638377062272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788748406.887834:0:6697:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00080000:2.0:1788748406.887854:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788748406.887864:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e2273, atime: 0x6a9e2273, ctime: 0x6a9e2273, blocks: 0x1 00010000:00010000:0.0:1788748406.887883:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.887897:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1788748406.887901:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748406.887908:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.887935:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.887946:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.887954:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.887978:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748406.888111:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748406.888119:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.888130:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748406.888134:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.888145:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.888162:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.888183:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f87443/0x5b377f42a7a7cba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748406.888201:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748406.888203:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748406.888205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748406.888717:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377062272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 900us (1177us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788748406.888725:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1788748406.889090:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdc60bbb80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788748406.889098:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377062272:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788748406.893365:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748406.894101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.894195:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193536 00000100:00100000:3.0:1788748406.894205:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193536 00000100:00100000:1.0:1788748406.894304:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788748406.894318:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358193536:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788748406.975083:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788748406.975104:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788748406.975112:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788748406.975536:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358193536:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 81217us (81435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.975548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1788748406.978060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.978486:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193792 00000100:00100000:3.0:1788748406.978496:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193792 00000100:00100000:3.0:1788748406.978555:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:3.0:1788748406.978564:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:11508:x1875638358193792:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.978614:0:8052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748406.978641:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cb90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e8 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.978657:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748406.978661:0:8052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748406.978690:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.978702:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.978710:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748406.978952:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000842c48a1 reply state 000000005eeaa5d9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.978961:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748406.979072:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11508:x1875638358193792:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 507us (1020us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788748406.979079:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 183 00010000:00010000:0.0:1788748406.984377:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984394:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984413:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984420:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ec00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748406.984424:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984432:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984447:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748406.984451:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748406.984456:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.984463:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cbac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748406.987945:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.988004:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358193920 00000100:00100000:3.0:1788748406.988042:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358193920 00000100:00100000:3.0:1788748406.988092:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:3.0:1788748406.988103:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358193920:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788748406.990193:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788748406.990200:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788748406 -> 1788748405 00002000:00010000:0.0:1788748406.990203:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788748403 00002000:00010000:0.0:1788748406.990205:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788748406 -> 1788748405 00002000:00010000:0.0:1788748406.990207:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788748406.990273:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358193920:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 2169us (2333us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788748406.990282:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1788748406.994447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748406.994555:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194176 00000100:00100000:3.0:1788748406.994565:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194176 00000100:00100000:3.0:1788748406.994621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:3.0:1788748406.994631:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:11508:x1875638358194176:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788748406.994691:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.994775:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.994787:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.994823:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.994837:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 18 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.994851:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377062400:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748406.994950:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748406.998536:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875638377062400:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748406.998541:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1788748406.998567:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748406.998733:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194304 00000100:00100000:0.0:1788748406.998741:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194304 00010000:00010000:0.0:1788748406.998777:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 19 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748406.998827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1788748406.998837:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed420850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:2348:x1875638358194304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748406.998852:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748406.998859:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 19 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998871:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 19 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998893:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cb74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218da expref: 19 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998908:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748406.998912:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998936:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998945:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748406.998969:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748406.999054:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed420850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:2348:x1875638358194304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748406.999064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00010000:00010000:3.0:1788748406.999066:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999076:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999104:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999112:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999119:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999125:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748406.999129:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999136:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999147:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748406.999150:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788748406.999154:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748406.999171:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748406.999234:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:11508:x1875638358194176:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 4604us (4795us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788748406.999242:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:2.0:1788748407.005291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.005953:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194432 00000100:00100000:1.0:1788748407.005965:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194432 00000100:00100000:1.0:1788748407.006046:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1788748407.006057:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358194432:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748407.006103:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.006124:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.006134:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788748407.006138:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748407.006142:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.006208:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.006224:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 8 pid: 6695 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.006239:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875638377062528:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748407.006315:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748407.009940:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875638377062528:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748407.009971:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.012884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.013171:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194560 00000100:00100000:3.0:1788748407.013182:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194560 00010000:00010000:3.0:1788748407.013221:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.013265:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788748407.013275:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358194560:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748407.013364:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748407.013389:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.013462:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.013491:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7cb9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218f6 expref: 9 pid: 6695 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.013505:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748407.013509:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748407.013515:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.013538:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.013585:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748407.013768:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013781:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013807:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013815:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013835:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013843:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748407.013847:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013856:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013869:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.013877:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7473b50/0x5b377f42a7a7cbba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.014749:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358194560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1470us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.014760:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1788748407.014814:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358194432:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 8757us (9542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.014824:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1788748407.031236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.031749:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194816 00000100:00100000:3.0:1788748407.031760:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194816 00000100:00100000:3.0:1788748407.031836:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:3.0:1788748407.031849:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+17:11508:x1875638358194816:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788748407.031937:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.031955:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.031968:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.032207:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.032219:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.032228:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.032269:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.032283:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 18 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.032296:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377062656:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748407.032381:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc9c00 going to sleep for 11 seconds 00000100:00080000:2.0:1788748407.032754:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748407.046126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748407.046184:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377062656:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748407.046209:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.046410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358194944 00000100:00100000:1.0:1788748407.046417:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358194944 00010000:00010000:1.0:1788748407.046453:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 19 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.047818:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788748407.047843:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:2347:x1875638358194944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748407.047859:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748407.047868:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 19 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047882:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 19 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047905:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cb82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218e1 expref: 19 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047917:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748407.047934:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047944:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047952:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.047979:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748407.048048:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+18:2347:x1875638358194944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 208us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.048055:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00010000:00010000:0.0:1788748407.049719:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.049738:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748407.049918:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788748407.051757:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788748407.051809:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788748407.051893:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377062784:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788748407.051967:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748407.052008:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748407.052894:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377062784 00000100:00100000:3.0:1788748407.052904:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377062784 00000100:00100000:3.0:1788748407.052969:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748407.052980:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8052:x1875638377062784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788748407.053093:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8052:x1875638377062784:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.053100:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748407.053354:0:8052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788748407.053360:0:8052:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ced2ad4e00, transno 4294967315 00000100:00100000:0.0:1788748407.053412:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377062784:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788748407.054105:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788748407.054188:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377062912:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788748407.054233:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748407.054260:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748407.057063:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377062912 00000100:00100000:3.0:1788748407.057078:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377062912 00000100:00100000:3.0:1788748407.057130:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748407.057140:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8052:x1875638377062912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788748407.057398:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8052:x1875638377062912:12345-0@lo:1000:mdt00_003.0 Request processed in 259us (3163us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788748407.057406:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748407.058050:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377062912:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788748407.058090:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058100:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058108:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058114:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748407.058118:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058135:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058151:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748407.058154:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748407.058159:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058166:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cbc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058194:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058201:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058207:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058211:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748407.058214:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058220:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058227:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:0.0:1788748407.058230:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748407.058233:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058247:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7cafd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058268:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058283:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 21 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058292:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058325:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 21 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.058340:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 21 pid: 8052 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748407.058352:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377063040:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748407.058423:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748407.063389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.063484:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377063040:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748407.063513:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.063880:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358195072 00000100:00100000:2.0:1788748407.063888:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358195072 00010000:00010000:2.0:1788748407.063931:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 22 pid: 8052 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.063998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1788748407.064008:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:2347:x1875638358195072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748407.064048:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748407.064055:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 22 pid: 8052 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064067:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 22 pid: 8052 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064088:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cb19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218c5 expref: 22 pid: 8052 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064102:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:2.0:1788748407.064113:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064123:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064129:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.064150:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748407.064195:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:2347:x1875638358195072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 189us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748407.064201:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00010000:00010000:1.0:1788748407.064255:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064262:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064273:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064279:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064285:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064291:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.064295:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064302:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064311:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748407.064313:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.064318:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064324:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cbcf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064336:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064349:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064355:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064359:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.064362:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064369:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064377:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748407.064380:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748407.064383:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.064388:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cbc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.064585:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11508:x1875638358194816:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 32739us (33358us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788748407.064594:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000020:00080000:1.0:1788748407.064597:0:8052:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788748407.064709:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748407.064714:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748407.065041:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788748407.065048:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748407.078935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.079426:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358195328 00000100:00100000:0.0:1788748407.079436:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358195328 00000100:00100000:0.0:1788748407.079482:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1788748407.079491:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11508:x1875638358195328:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748407.080163:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748407.080270:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788748407.080315:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080337:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080349:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080358:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080363:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080369:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.080392:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788748407.080481:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:11508:x1875638358195328:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 989us (1565us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788748407.080489:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000020:00080000:0.0:1788748407.080495:0:5847:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788748407.081132:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748407.081141:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.081148:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748407.081152:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.081160:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.081173:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748407.081177:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788748407.081182:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.081187:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cbd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.081217:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748407.081219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748407.081221:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748407.097175:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748407.097184:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748407.097219:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788748407.097224:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748407.294855:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748407.295123:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358195584 00000100:00100000:2.0:1788748407.295132:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358195584 00000100:00100000:2.0:1788748407.295186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:2.0:1788748407.295197:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:11518:x1875638358195584:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748407.295220:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748407.295241:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7cbdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265218fd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.295809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7cbe4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.295825:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7cbe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.295836:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7cbe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748407.295847:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788748407.296997:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7cbdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218fd expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.298825:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7cbe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218fd expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.298843:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748407.298854:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748407.298858:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2e00, rc 0) 00000100:00100000:2.0:1788748407.299090:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11518:x1875638358195584:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 3893us (4241us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788748407.299100:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:1.0:1788748407.305466:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.305528:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358195712 00000100:00100000:1.0:1788748407.305538:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358195712 00000100:00100000:1.0:1788748407.305601:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:1.0:1788748407.305887:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11518:x1875638358195712:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1788748407.305973:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.305989:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306000:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306046:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306054:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306062:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306301:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306310:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306318:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748407.306355:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306375:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.306382:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307295:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307308:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.307312:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307321:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307334:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748407.307337:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.307835:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307846:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cbf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307864:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307872:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307879:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307903:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.307907:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307934:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cecfaeff00) 00010000:00010000:1.0:1788748407.307937:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.307941:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307947:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8400/0x5b377f42a7a7cbf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307971:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307978:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307984:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307989:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.307992:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.307999:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.308047:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:1.0:1788748407.308050:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.308054:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.308060:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.308162:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11518:x1875638358195712:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 2547us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.308171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:3.0:1788748407.369592:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.369663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358195968 00000100:00100000:0.0:1788748407.369674:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358195968 00000100:00100000:0.0:1788748407.369741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:0.0:1788748407.369751:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11521:x1875638358195968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748407.369771:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748407.369818:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cc07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521904 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369902:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369917:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369952:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369958:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.369964:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.370256:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.370265:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.370273:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748407.370298:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788748407.376408:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376425:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376433:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376440:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.376444:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376452:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376469:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748407.376472:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.376478:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376498:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cc0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376797:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376805:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376821:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376825:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.376828:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376833:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376842:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09b00) 00010000:00010000:1.0:1788748407.376844:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.376847:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376852:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cc15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cc07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376949:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.376963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.376966:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748407.376968:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147ce00, rc 0) 00000100:00100000:1.0:1788748407.377060:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:11521:x1875638358195968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 7308us (7476us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788748407.377070:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:0.0:1788748407.400999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.404125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358196096 00000100:00100000:1.0:1788748407.404141:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358196096 00000100:00100000:1.0:1788748407.404289:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:1.0:1788748407.404301:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:11521:x1875638358196096:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1788748407.404370:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404386:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404400:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404426:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404433:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404440:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404447:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.404465:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404473:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404484:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.404487:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748407.404493:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.404499:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.404602:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:11521:x1875638358196096:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 302us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.406879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:0.0:1788748407.407842:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.407959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358196352 00000100:00100000:3.0:1788748407.407974:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358196352 00000100:00100000:3.0:1788748407.408046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788748407.408058:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+26:11521:x1875638358196352:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748407.408287:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:11521:x1875638358196352:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 219us (436us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788748407.408295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:3.0:1788748407.457198:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748407.462434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358196608 00000100:00100000:2.0:1788748407.462451:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358196608 00000100:00100000:2.0:1788748407.462526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:2.0:1788748407.462538:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:11054:x1875638358196608:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748407.462573:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748407.462595:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7cc31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652190b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.462947:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.462963:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.462972:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.463006:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.463040:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 28 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.463054:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7257800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377063168:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748407.463214:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748407.474803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.475049:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358196736 00000100:00100000:1.0:1788748407.475059:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358196736 00010000:00010000:1.0:1788748407.475101:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 29 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748407.475130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1788748407.475138:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:2347:x1875638358196736:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748407.475166:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748407.475173:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 29 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.475186:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 29 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.475225:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.475230:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.475240:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.475248:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.475264:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748407.475322:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:2347:x1875638358196736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 184us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.475329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00010000:00010000:2.0:1788748407.475705:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cc1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521904 expref: 28 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.475724:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7257800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377063168:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748407.475746:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.475755:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.475761:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748407.475780:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788748407.476545:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7cc31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.476723:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.476731:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:2.0:1788748407.476734:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748407.476737:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748407.476843:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+28:11054:x1875638358196608:12345-192.168.203.4@tcp:101:bash.0 Request processed in 14306us (19653us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788748407.476852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1788748407.494196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748407.494275:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358196992 00000100:00100000:2.0:1788748407.494298:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358196992 00000100:00100000:2.0:1788748407.494350:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:2.0:1788748407.494360:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+28:11054:x1875638358196992:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1788748407.494641:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.494659:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.494670:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748407.494722:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788748407.494749:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005c585fdf reply state 000000005c60f627 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.494758:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788748407.494818:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788748407.494936:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11054:x1875638358196992:12345-192.168.203.4@tcp:36:bash.0 Request processed in 576us (748us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788748407.494943:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000020:00080000:2.0:1788748407.494948:0:8052:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788748407.500073:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.500145:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197120 00000100:00100000:1.0:1788748407.500155:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197120 00000100:00100000:1.0:1788748407.500206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:1.0:1788748407.500216:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11054:x1875638358197120:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748407.500236:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748407.500254:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521912 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.500308:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521912 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.500323:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521912 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.500360:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.500364:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748407.500368:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9e00, rc 0) 00000100:00100000:1.0:1788748407.500423:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+33:11054:x1875638358197120:12345-192.168.203.4@tcp:101:bash.0 Request processed in 208us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748407.500429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00010000:00010000:3.0:1788748407.500735:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500744:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500752:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500758:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748407.500762:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500770:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500780:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:3.0:1788748407.500783:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748407.500787:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.500794:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cc46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.511165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748407.511281:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197248 00000100:00100000:2.0:1788748407.511293:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197248 00000100:00100000:2.0:1788748407.511344:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788748407.511355:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:11054:x1875638358197248:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748407.511373:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748407.511405:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521919 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748407.511448:0:8053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e2275, atime: 0x6a9e2273, ctime: 0x6a9e2275, blocks: 0xb 00010000:00010000:2.0:1788748407.511469:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1788748407.511474:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748407.511483:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 8 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.511500:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 8 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.511512:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2800, rc 0) 00000100:00100000:2.0:1788748407.511575:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:11054:x1875638358197248:12345-192.168.203.4@tcp:101:bash.0 Request processed in 222us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748407.511583:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1788748407.531617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.533841:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197376 00000100:00100000:1.0:1788748407.533856:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197376 00002000:00010000:1.0:1788748407.533902:0:6702:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788748407.533907:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdc60b8a80 with x1875638358197376 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748407.533930:0:6702:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cdc60b8a80. 00000100:00100000:1.0:1788748407.533971:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748407.533982:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2349:x1875638358197376:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:1.0:1788748407.535644:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788748407.535653:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788748405 -> 1788748406 00002000:00010000:1.0:1788748407.535656:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788748403 -> 1788748403 00002000:00010000:1.0:1788748407.535659:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788748405 -> 1788748406 00002000:00010000:1.0:1788748407.535661:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788748407.535741:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2349:x1875638358197376:12345-192.168.203.4@tcp:10:bash.0 Request processed in 1758us (4130us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788748407.535751:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00002000:00010000:1.0:1788748407.535756:0:6702:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788748407.535759:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdc60b8a80 with x1875638358197376 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748407.535766:0:6702:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cdc60b8a80. 00000100:00100000:1.0:1788748407.627566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.627750:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197504 00000100:00100000:3.0:1788748407.627761:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197504 00000100:00100000:3.0:1788748407.627827:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:3.0:1788748407.627837:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11535:x1875638358197504:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788748407.627909:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.627942:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.627955:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.627970:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.627977:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.627984:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628236:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628247:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628255:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748407.628301:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628314:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628320:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628326:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628332:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748407.628336:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628342:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628353:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748407.628357:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748407.628361:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628367:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cc5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628378:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628385:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628398:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628403:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748407.628406:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628413:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628421:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cece6d7d00) 00010000:00010000:3.0:1788748407.628424:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748407.628427:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628432:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cc62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628446:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628452:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628457:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628463:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748407.628466:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628482:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628490:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:3.0:1788748407.628493:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748407.628496:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.628502:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.628582:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11535:x1875638358197504:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 745us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.628590:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:3.0:1788748407.694772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.694927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197760 00000100:00100000:1.0:1788748407.694941:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197760 00000100:00100000:1.0:1788748407.695081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:1.0:1788748407.695093:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11538:x1875638358197760:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748407.695126:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748407.695154:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cc70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521920 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695256:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695276:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695290:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695306:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695321:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695786:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cc85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695797:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.695813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748407.695826:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788748407.696387:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696458:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696466:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696472:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.696477:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696486:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696501:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748407.696505:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.696512:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696518:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cc77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696703:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696710:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696724:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696730:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.696732:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696739:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696748:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cecfaef600) 00010000:00010000:1.0:1788748407.696750:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.696753:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7cc7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696816:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7cc70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521920 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696831:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521920 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.696838:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.696841:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788748407.696843:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748407.696943:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11538:x1875638358197760:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1851us (2184us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788748407.696962:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:0.0:1788748407.700885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.700976:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358197888 00000100:00100000:3.0:1788748407.700995:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358197888 00000100:00100000:3.0:1788748407.702293:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:3.0:1788748407.702316:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11538:x1875638358197888:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788748407.702418:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.702439:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.702451:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.702495:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.702542:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 34 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.702559:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377063296:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748407.702781:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccc96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748407.713056:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377063296:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748407.713109:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748407.714447:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.714597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198144 00000100:00100000:3.0:1788748407.714757:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198144 00000100:00100000:3.0:1788748407.714817:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788748407.714828:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:5588:x1875638358198144:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788748407.715372:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:5588:x1875638358198144:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 544us (932us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788748407.715381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788748407.757911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.757999:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198272 00000100:00100000:3.0:1788748407.758009:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198272 00010000:00010000:3.0:1788748407.758123:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 36 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748407.758314:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:3.0:1788748407.758327:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:2348:x1875638358198272:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748407.758345:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748407.758365:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 36 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758379:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 36 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758405:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cc38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652190b expref: 36 pid: 5846 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758420:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:3.0:1788748407.758427:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758437:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758444:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.758483:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748407.758548:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:2348:x1875638358198272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 222us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.758555:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:2.0:1788748407.758637:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758645:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758677:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758685:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758690:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758707:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748407.758712:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758720:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758731:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:2.0:1788748407.758734:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748407.758739:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748407.758745:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e200/0x5b377f42a7a7cc93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748407.758807:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11538:x1875638358197888:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 56500us (57931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748407.758815:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:0.0:1788748407.763847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.764317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198528 00000100:00100000:3.0:1788748407.764327:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198528 00000100:00100000:3.0:1788748407.764385:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1788748407.764395:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+34:11538:x1875638358198528:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1788748407.764752:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:11538:x1875638358198528:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 357us (912us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788748407.764775:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1788748407.843265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.843359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.844537:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198784 00000100:00100000:3.0:1788748407.844549:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198784 00000100:00100000:3.0:1788748407.844614:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788748407.844625:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358198784:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:2.0:1788748407.847693:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198656 00000100:00100000:2.0:1788748407.847708:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198656 00002000:00100000:2.0:1788748407.847783:0:6701:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff99ceed61ed80 x1875638358198656/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:153/0 lens 496/0 e 0 to 0 dl 1788748418 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748407.847794:0:6701:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99ceed61ed80 with x1875638358198656 ext(0->7) 00002000:00010000:2.0:1788748407.847801:0:6701:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ceed61ed80 00000100:00100000:2.0:1788748407.847836:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748407.847845:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358198656:12345-192.168.203.4@tcp:4:bash.0 00000100:00100000:2.0:1788748407.848310:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2348:x1875638358198656:12345-192.168.203.4@tcp:4:bash.0 Request processed in 465us (5054us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788748407.848324:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00002000:00100000:2.0:1788748407.848332:0:6701:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff99ceed61ed80 x1875638358198656/t4294967319(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:153/0 lens 496/448 e 0 to 0 dl 1788748418 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748407.848340:0:6701:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99ceed61ed80 with x1875638358198656 ext(0->7) 00002000:00010000:2.0:1788748407.848344:0:6701:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ceed61ed80 00000100:00100000:0.0:1788748407.863564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.863607:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.863634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.863662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358198912 00000100:00100000:0.0:1788748407.863671:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358198912 00000100:00100000:0.0:1788748407.863718:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:0.0:1788748407.863729:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358198912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748407.863799:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2347:x1875638358198912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748407.863819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:3.0:1788748407.864054:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358199040 00000100:00100000:3.0:1788748407.864060:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358199040 00000100:00100000:3.0:1788748407.864100:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:3.0:1788748407.864107:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358199040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748407.864137:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358199040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.864143:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00080000:2.0:1788748407.867110:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748407.867140:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358199168 00000100:00100000:2.0:1788748407.867151:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358199168 00000100:00100000:2.0:1788748407.867554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:2.0:1788748407.867566:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358199168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748407.867646:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2347:x1875638358199168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748407.867653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00080000:3.0:1788748407.867692:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788748407.880517:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1788748407.881117:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:3.0:1788748407.881595:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358198784:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 36967us (38230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748407.881607:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00010000:00010000:1.0:1788748407.920597:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748407.928134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748407.928328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358199424 00000100:00100000:1.0:1788748407.928338:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358199424 00000100:00100000:1.0:1788748407.928406:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1788748407.928417:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+35:11549:x1875638358199424:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1788748407.928441:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748407.928469:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cc9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521927 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928537:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928560:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928570:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928586:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.928600:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929310:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7ccaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929322:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7ccaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929331:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7ccaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748407.929342:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788748407.929810:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929819:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929825:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929830:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.929834:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929840:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929852:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748407.929855:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.929859:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7cca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929892:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929897:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929903:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929907:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748407.929910:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929927:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929935:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cecfaeff00) 00010000:00010000:1.0:1788748407.929938:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748407.929941:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.929946:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9000/0x5b377f42a7a7cca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.930193:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9c00/0x5b377f42a7a7cc9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521927 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.930210:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7ccaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521927 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748407.930224:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:1.0:1788748407.930227:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748407.930230:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9a00, rc 0) 00000100:00100000:1.0:1788748407.930301:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11549:x1875638358199424:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1885us (2175us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788748407.930310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:0.0:1788748407.936090:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748407.936229:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358199680 00000100:00100000:3.0:1788748407.936240:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358199680 00000100:00100000:3.0:1788748407.936299:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:3.0:1788748407.936310:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11549:x1875638358199680:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:3.0:1788748407.936576:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:11549:x1875638358199680:12345-192.168.203.4@tcp:35:cat.0 Request processed in 267us (494us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788748407.936584:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788748407.987798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748407.988206:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358199936 00000100:00100000:0.0:1788748407.988217:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358199936 00000100:00100000:0.0:1788748407.988274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:0.0:1788748407.988284:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:11550:x1875638358199936:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1788748407.988340:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788748407.988381:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9a00/0x5b377f42a7a7ccaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521927 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988428:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9200/0x5b377f42a7a7cc85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521920 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988452:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7cc4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521912 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988462:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09c00) 00010000:00010000:0.0:1788748407.988473:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748407.988493:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988515:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988526:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988541:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.988556:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.989768:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.989784:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.989803:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748407.990874:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788748407.990887:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325033871681ns, next at 326033868788ns, rc = 0 00010000:00010000:0.0:1788748407.990965:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.990978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.990988:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.990996:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991002:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991008:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991398:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748407.991442:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991450:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991456:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991470:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748407.991474:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991481:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991501:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:0.0:1788748407.991504:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788748407.991510:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991516:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cccb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991538:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991544:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991550:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991555:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748407.991558:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991563:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991581:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748407.991584:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748407.991588:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.991593:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7ccbd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748407.991614:0:5844:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003079f9b9 reply state 000000008a25486b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748407.991623:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748407.991723:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+37:11550:x1875638358199936:12345-192.168.203.4@tcp:36:rm.0 Request processed in 3437us (3930us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788748407.991732:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00010000:00010000:3.0:1788748407.992931:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748407.992942:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.992961:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147ce00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748407.992965:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.992972:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.992984:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cec3e09200) 00010000:00010000:3.0:1788748407.992987:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748407.992991:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.992997:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7ccd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748407.993038:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748407.993041:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748407.993042:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748407.993345:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993353:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993359:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993364:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748407.993368:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993374:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993394:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748407.993397:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748407.993401:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748407.993665:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7ccc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.062278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.063570:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200192 00000100:00100000:3.0:1788748408.063584:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200192 00000100:00100000:3.0:1788748408.063640:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:3.0:1788748408.063650:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+36:11556:x1875638358200192:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748408.063674:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748408.063694:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7ccd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652192e expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063804:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063837:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063848:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063863:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063871:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.063878:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748408.064430:0:8052:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788748408.064600:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064612:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064620:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064651:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064658:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064665:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064678:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748408.064683:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064689:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064702:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748408.064705:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748408.064710:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064716:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cce0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748408.064729:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001f5e35c4 reply state 00000000564b7099 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.064738:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788748408.064766:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7ccd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 39 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064780:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 38 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.064788:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:3.0:1788748408.064790:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748408.064792:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f200, rc 0) 00000100:00100000:3.0:1788748408.064873:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:11556:x1875638358200192:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1223us (2604us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788748408.064888:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:3.0:1788748408.085654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.085685:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200320 00000100:00100000:3.0:1788748408.085694:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200320 00000100:00100000:3.0:1788748408.085742:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788748408.085753:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358200320:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748408.085771:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748408.085790:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521935 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748408.085816:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748408.085833:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1788748408.085838:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748408.085847:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.085867:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.085880:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f400, rc 0) 00000100:00100000:3.0:1788748408.085940:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358200320:12345-192.168.203.4@tcp:101:bash.0 Request processed in 189us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748408.085947:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00010000:00010000:3.0:1788748408.085975:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086000:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086007:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086034:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ec00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748408.086040:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086049:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086062:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cece6d7d00) 00010000:00010000:3.0:1788748408.086066:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748408.086070:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.086076:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.104477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.104590:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200448 00000100:00100000:1.0:1788748408.104602:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200448 00000100:00100000:1.0:1788748408.104664:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1788748408.104674:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:11556:x1875638358200448:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748408.104694:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748408.104712:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652193c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.104745:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.104754:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748408.104759:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748408.104764:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.104796:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.104827:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 9 pid: 6697 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.104841:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377063424:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748408.104944:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748408.111680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.111753:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200576 00000100:00100000:3.0:1788748408.111763:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200576 00010000:00010000:3.0:1788748408.111828:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 10 pid: 6697 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.111876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788748408.111886:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2347:x1875638358200576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748408.111901:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748408.111946:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 10 pid: 6697 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.111960:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 10 pid: 6697 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.111985:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748408.111990:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748408.111999:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.112008:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.112087:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.112110:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875638377063552:192.168.203.4@tcp:105: 00000100:00100000:3.0:1788748408.112196:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5123600 going to sleep for 11 seconds 00010000:00010000:1.0:1788748408.112620:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7ccfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521935 expref: 10 pid: 6697 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.112636:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875638377063424:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748408.112659:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.112670:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748408.112708:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:11556:x1875638358200448:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8035us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.112716:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1788748408.123885:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.123927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200832 00000100:00100000:2.0:1788748408.123936:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200832 00000100:00100000:2.0:1788748408.123980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1788748408.123990:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+38:11556:x1875638358200832:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1788748408.124346:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:11556:x1875638358200832:12345-192.168.203.4@tcp:35:bash.0 Request processed in 355us (469us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788748408.124369:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:0.0:1788748408.124968:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875638377063552:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748408.124990:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748408.125053:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358200576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 13168us (13380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.125062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000001:00080000:1.0:1788748408.209575:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788748408.209592:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788748408.209598:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1788748408.369924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.376374:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358200960 00000100:00100000:0.0:1788748408.376397:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358200960 00000100:00100000:0.0:1788748408.376479:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:0.0:1788748408.376490:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+39:11572:x1875638358200960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748408.376523:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748408.376542:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521943 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377350:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377365:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377376:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748408.377443:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788748408.377446:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748408.377462:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377486:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521943 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377506:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521943 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.377513:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748408.377517:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748408.377520:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:0.0:1788748408.377588:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11572:x1875638358200960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1099us (7683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.377595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:2.0:1788748408.383055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.383129:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201216 00000100:00100000:3.0:1788748408.383139:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201216 00000100:00100000:3.0:1788748408.383208:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1788748408.383218:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+40:11572:x1875638358201216:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748408.383237:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748408.383258:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652194a expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.386199:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cd1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.386227:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cd1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.386247:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cd1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748408.386269:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788748408.390373:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652194a expref: 43 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.390414:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cd1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652194a expref: 42 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.390424:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:3.0:1788748408.390427:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748408.390431:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fa00, rc 0) 00000100:00100000:3.0:1788748408.390498:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+42:11572:x1875638358201216:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 7281us (7487us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788748408.390506:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1788748408.399245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.399304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.399383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201600 00000100:00100000:2.0:1788748408.399393:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201600 00000100:00100000:2.0:1788748408.399469:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:2.0:1788748408.399480:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+42:11572:x1875638358201600:12345-192.168.203.4@tcp:101:lfs.0 00000100:00100000:0.0:1788748408.399499:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201344 00000100:00100000:0.0:1788748408.399505:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201344 00010000:00010000:2.0:1788748408.399506:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748408.399530:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521951 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.399555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788748408.399564:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed422450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+44:2347:x1875638358201344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748408.399575:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748408.399595:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7cd1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652194a expref: 44 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.399611:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:0.0:1788748408.399627:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748408.399628:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.399643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.399655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748408.399667:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:0.0:1788748408.399681:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed422450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:2347:x1875638358201344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 116us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.399689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:2.0:1788748408.399791:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521951 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.399806:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521951 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.399813:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:2.0:1788748408.399823:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788748408.399827:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748408.402187:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:11572:x1875638358201600:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2699us (2872us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788748408.402200:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:3.0:1788748408.416070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.416175:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201728 00000100:00100000:1.0:1788748408.416186:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201728 00000100:00100000:1.0:1788748408.416239:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1788748408.416248:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+6:2347:x1875638358201728:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:1.0:1788748408.416319:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.416340:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.416349:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748408.416354:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748408.416358:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.416406:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.416419:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 6 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.416432:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875638377063680:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748408.416509:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748408.428113:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875638377063680:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748408.428141:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.429044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.429122:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201856 00000100:00100000:1.0:1788748408.429129:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201856 00002000:00100000:1.0:1788748408.429174:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99cef7307100 x1875638358201856/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:154/0 lens 504/0 e 0 to 0 dl 1788748419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748408.429196:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7307100 with x1875638358201856 ext(0->8) 00010000:00010000:1.0:1788748408.429206:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 7 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.429221:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 7 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748408.429229:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cef7307100 00000100:00100000:1.0:1788748408.429264:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748408.429275:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358201856:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:1.0:1788748408.429791:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358201856:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 516us (774us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788748408.429799:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:1.0:1788748408.429806:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99cef7307100 x1875638358201856/t4294967308(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:154/0 lens 504/448 e 0 to 0 dl 1788748419 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748408.429815:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cef7307100 with x1875638358201856 ext(0->8) 00010000:00010000:1.0:1788748408.429821:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.429833:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748408.429840:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99cef7307100 00000100:00100000:3.0:1788748408.432982:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.433138:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358201984 00000100:00100000:2.0:1788748408.433149:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358201984 00010000:00010000:2.0:1788748408.433189:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.433235:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1788748408.433245:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358201984:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748408.433260:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788748408.433278:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788748408.433281:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788748407 00002000:00010000:2.0:1788748408.433283:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788748407 00002000:00010000:2.0:1788748408.433284:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788748407 00010000:00010000:2.0:1788748408.433290:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.433303:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.433324:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa58f0b/0x5b377f42a7a7cd03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652193c expref: 9 pid: 6695 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.433340:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748408.433357:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748408.433362:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.433372:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.433408:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.433460:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358201984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 215us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.433468:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00010000:00010000:1.0:1788748408.433473:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433491:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433515:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433523:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433531:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433538:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748408.433543:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433552:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433564:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.433572:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae4c4cef/0x5b377f42a7a7cd42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.433625:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358201728:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 17378us (17610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.433634:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1788748408.440204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.440312:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358202240 00000100:00100000:2.0:1788748408.440322:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358202240 00000100:00100000:2.0:1788748408.440367:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1788748408.440377:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+43:11572:x1875638358202240:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:2.0:1788748408.440439:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521951 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748408.440681:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788748408.440726:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788748408.441064:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788748408.441124:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.441139:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 47 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.441148:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.441199:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 47 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.441213:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 47 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.441227:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377063808:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748408.441309:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748408.448620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.448729:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358202368 00000100:00100000:0.0:1788748408.448739:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358202368 00010000:00010000:0.0:1788748408.448778:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 48 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.448818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:0.0:1788748408.448828:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:2347:x1875638358202368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748408.448844:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748408.448851:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 48 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.448867:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 48 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.448888:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:0.0:1788748408.448895:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.448904:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.448922:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.448954:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748408.449055:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+48:2347:x1875638358202368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.449062:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00010000:00010000:2.0:1788748408.449724:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f200/0x5b377f42a7a7ccee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652192e expref: 47 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.449741:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875638377063808:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748408.449764:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.449773:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.449779:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748408.449899:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788748408.450155:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788748408.450259:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377063936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748408.450318:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748408.450343:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748408.450472:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377063936 00000100:00100000:3.0:1788748408.450479:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377063936 00000100:00100000:3.0:1788748408.450543:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748408.450553:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377063936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748408.450625:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377063936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748408.450632:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788748408.450946:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748408.450982:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788748408.450988:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788748408.451003:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdc60bbb80, transno 4294967307 00000100:00100000:2.0:1788748408.451053:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377063936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788748408.451661:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788748408.451729:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377064064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748408.451765:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748408.451783:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748408.452100:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377064064 00000100:00100000:3.0:1788748408.452105:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377064064 00000100:00100000:3.0:1788748408.452148:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748408.452156:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875638377064064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748408.452337:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875638377064064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 181us (570us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788748408.452344:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748408.452666:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7255f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875638377064064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788748408.452718:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788748408.452756:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452766:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452774:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452780:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748408.452784:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452792:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452807:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:2.0:1788748408.452810:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788748408.452814:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.452833:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd49 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748408.453000:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788748408.453103:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788748408.453115:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325496100110ns, next at 326496097430ns, rc = 0 00000001:00080000:2.0:1788748408.453122:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788748408.453151:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cece6d7c00) 00010000:00010000:2.0:1788748408.453154:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788748408.453160:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7cd34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521951 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.453256:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:11572:x1875638358202240:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 12879us (13060us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788748408.453265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000020:00080000:2.0:1788748408.453269:0:5848:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788748408.468250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.468353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358202496 00000100:00100000:1.0:1788748408.468363:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358202496 00000100:00100000:1.0:1788748408.468430:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:1.0:1788748408.468442:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+50:11572:x1875638358202496:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748408.468465:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748408.468487:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cd50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521958 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.468738:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cd50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521958 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.468754:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cd50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521958 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.468773:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:1.0:1788748408.468776:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748408.468780:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8e00, rc 0) 00000100:00100000:1.0:1788748408.468848:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:11572:x1875638358202496:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 408us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.468855:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:3.0:1788748408.481630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.482659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358202752 00000100:00100000:0.0:1788748408.482670:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358202752 00000100:00100000:0.0:1788748408.482733:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1788748408.482744:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+51:11572:x1875638358202752:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748408.482989:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11572:x1875638358202752:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 246us (1365us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788748408.482996:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1788748408.642151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748408.645851:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358202880 00000100:00100000:3.0:1788748408.645865:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358202880 00000100:00100000:3.0:1788748408.646550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:3.0:1788748408.646562:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11582:x1875638358202880:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1788748408.646647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646674:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646707:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646714:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646720:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646805:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646814:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646832:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748408.646870:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646883:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646889:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646896:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646901:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ec00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748408.646920:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646935:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:3.0:1788748408.646949:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748408.646954:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646960:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7cd57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646973:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.646979:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647579:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647594:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748408.647597:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647604:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647613:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cece6d7900) 00010000:00010000:3.0:1788748408.647616:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748408.647619:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647637:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7cd5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647654:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647659:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647664:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647669:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748408.647672:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647677:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647684:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:3.0:1788748408.647687:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748408.647690:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748408.647696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7cd65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748408.647781:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11582:x1875638358202880:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1220us (5637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748408.647790:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:3.0:1788748408.726257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.726427:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358203136 00000100:00100000:2.0:1788748408.726436:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358203136 00000100:00100000:2.0:1788748408.726505:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:2.0:1788748408.726514:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+52:11585:x1875638358203136:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748408.726533:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748408.726552:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652195f expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726844:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726859:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726887:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726903:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726919:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.726926:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727054:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727063:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727070:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748408.727080:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788748408.727172:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727180:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727187:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727193:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748408.727204:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727211:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727222:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748408.727226:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748408.727230:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727237:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cd73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727249:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727254:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727259:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.727264:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748408.728562:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728574:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728661:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec6646700) 00010000:00010000:2.0:1788748408.728665:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748408.728684:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728692:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7cd7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728819:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7cd6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 55 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728836:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 54 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.728843:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.728846:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748408.728848:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748408.729049:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11585:x1875638358203136:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2447us (2712us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788748408.729057:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:2.0:1788748408.736292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.736474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358203264 00000100:00100000:0.0:1788748408.736484:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358203264 00000100:00100000:0.0:1788748408.736541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:0.0:1788748408.736551:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11585:x1875638358203264:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788748408.736629:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736646:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736657:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736682:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736706:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736713:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736719:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748408.736723:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736730:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736742:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748408.736745:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748408.736749:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.736754:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cd8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.736966:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11585:x1875638358203264:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 415us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.736975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:0.0:1788748408.740979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.741178:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358203520 00000100:00100000:2.0:1788748408.741188:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358203520 00000100:00100000:2.0:1788748408.741450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788748408.741462:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+54:11585:x1875638358203520:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788748408.741860:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11585:x1875638358203520:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 398us (888us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788748408.741868:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1788748408.833221:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.833331:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358203776 00000100:00100000:1.0:1788748408.833341:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358203776 00000100:00100000:1.0:1788748408.833512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:1.0:1788748408.833523:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11595:x1875638358203776:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748408.833548:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748408.833551:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788748408.833576:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cd11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521943 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833596:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:1.0:1788748408.833602:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748408.833614:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7cd96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521966 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833708:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833722:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 55 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833729:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833762:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 55 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.833776:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 55 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.833788:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377064192:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748408.833884:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748408.840878:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.840972:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358203904 00000100:00100000:2.0:1788748408.840992:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358203904 00010000:00010000:2.0:1788748408.841062:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 56 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.841102:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1788748408.841113:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:2348:x1875638358203904:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748408.841127:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748408.841133:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 56 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.841146:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 56 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.841176:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.841182:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.841191:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.841199:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.841217:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.841270:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+56:2348:x1875638358203904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 159us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.841278:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00010000:00010000:1.0:1788748408.841731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7cd81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652195f expref: 55 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.841748:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377064192:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748408.841767:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.841776:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.841781:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748408.841801:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788748408.841948:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7cd96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.841964:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.841972:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:1.0:1788748408.841974:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748408.841976:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9600, rc 0) 00000100:00100000:1.0:1788748408.842053:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11595:x1875638358203776:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8532us (8840us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788748408.842059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:3.0:1788748408.850782:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.850881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204160 00000100:00100000:2.0:1788748408.850891:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204160 00000100:00100000:2.0:1788748408.850970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:2.0:1788748408.850980:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+55:11595:x1875638358204160:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1788748408.851282:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.851299:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.851320:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748408.851376:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788748408.851750:0:5844:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e418052e reply state 00000000e4abae34 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.851760:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748408.851902:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11595:x1875638358204160:12345-192.168.203.4@tcp:36:bash.0 Request processed in 921us (1126us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788748408.851918:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 207 00000020:00080000:2.0:1788748408.851923:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788748408.855803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1788748408.855892:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855904:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855939:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855946:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748408.855951:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855960:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855976:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748408.855980:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748408.855984:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.855991:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7cdab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.856129:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204288 00000100:00100000:1.0:1788748408.856144:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204288 00000100:00100000:1.0:1788748408.856209:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:1.0:1788748408.856219:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11595:x1875638358204288:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748408.856241:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748408.856257:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7cdb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652196d expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.856354:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.856368:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.856376:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.856411:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.856424:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 58 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748408.856436:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377064320:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748408.857614:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748408.860627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.860740:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceed61df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377064320:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748408.860766:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.860974:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204416 00000100:00100000:2.0:1788748408.860981:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204416 00010000:00010000:2.0:1788748408.861038:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 59 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.861073:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788748408.861081:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:2348:x1875638358204416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748408.861094:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748408.861100:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 59 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861124:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 59 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861144:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7cd9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521966 expref: 59 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861157:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.861171:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861180:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861188:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.861215:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.861275:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:2348:x1875638358204416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 194us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.861282:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00010000:00010000:1.0:1788748408.861500:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.861513:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748408.861558:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788748408.861562:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748408.861582:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.861612:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7cdb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 58 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.861625:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 57 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.861632:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:1.0:1788748408.861634:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748408.861637:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8a00, rc 0) 00000100:00100000:1.0:1788748408.861665:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11595:x1875638358204288:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5448us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.861671:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:2.0:1788748408.866315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.866378:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204672 00000100:00100000:0.0:1788748408.866397:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204672 00000100:00100000:0.0:1788748408.866464:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1788748408.866474:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+57:11595:x1875638358204672:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1788748408.866708:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11595:x1875638358204672:12345-192.168.203.4@tcp:35:bash.0 Request processed in 235us (410us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788748408.866715:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1788748408.938858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.938974:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204800 00000100:00100000:0.0:1788748408.938984:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204800 00000100:00100000:0.0:1788748408.939067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:0.0:1788748408.939078:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+58:11601:x1875638358204800:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748408.939119:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748408.939139:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cdc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521974 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939232:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939244:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748408.939290:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788748408.939294:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748408.939320:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939345:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147ce00/0x5b377f42a7a7cdc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521974 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939364:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521974 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.939372:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748408.939375:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748408.939378:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d800, rc 0) 00000100:00100000:0.0:1788748408.939461:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358204800:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 384us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.939468:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00010000:00010000:2.0:1788748408.941450:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748408.943611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.943699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358204928 00000100:00100000:0.0:1788748408.943709:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358204928 00000100:00100000:0.0:1788748408.943769:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:0.0:1788748408.943779:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358204928:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748408.943801:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748408.943821:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cdce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652197b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943879:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943893:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943903:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943930:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943946:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.943954:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944657:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944669:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944695:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748408.944731:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788748408.944735:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748408.944752:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944764:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944772:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944779:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944786:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944792:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748408.944796:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944803:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944813:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748408.944816:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748408.944821:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944837:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d200/0x5b377f42a7a7cdd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944854:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944860:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944865:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944870:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748408.944873:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944879:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944887:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748408.944889:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748408.944892:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944898:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944942:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cdce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944957:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.944970:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748408.944973:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748408.944976:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748408.945339:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11601:x1875638358204928:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1559us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748408.945347:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:3.0:1788748408.949193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748408.949311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205184 00000100:00100000:0.0:1788748408.949321:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205184 00000100:00100000:0.0:1788748408.949381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:0.0:1788748408.949391:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11601:x1875638358205184:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748408.949411:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748408.949431:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cdea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521982 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949531:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949545:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 61 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949553:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949561:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949593:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949613:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.949627:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb80ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377064448:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748408.949734:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 61 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.949743:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 61 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.949751:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb80a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377064576:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748408.949774:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748408.954922:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.955044:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205312 00000100:00100000:2.0:1788748408.955055:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205312 00010000:00010000:2.0:1788748408.955095:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 62 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.955132:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1788748408.955155:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:2350:x1875638358205312:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748408.955170:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748408.955178:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 62 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.955191:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 62 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.955223:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.955227:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.955235:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.955241:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.955293:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:2350:x1875638358205312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.955300:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1788748408.956954:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.957046:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205440 00000100:00100000:2.0:1788748408.957053:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205440 00010000:00010000:2.0:1788748408.957083:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 62 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748408.957122:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:2.0:1788748408.957131:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:2348:x1875638358205440:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748408.957144:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748408.957150:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 62 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.957173:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 62 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.957193:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.957210:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.957219:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.957226:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.957245:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.957292:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:2348:x1875638358205440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 162us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.957299:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00010000:00010000:0.0:1788748408.958373:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000008a9d2299 x1875638377064448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.958402:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cde3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652197b expref: 61 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.958418:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb80ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377064448:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748408.958434:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7cdb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652196d expref: 60 pid: 8052 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748408.958444:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb80a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377064576:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748408.958477:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748408.958484:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.958493:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.958499:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748408.958521:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788748408.958663:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cdea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.958678:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748408.958685:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748408.958688:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748408.958690:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748408.958740:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11601:x1875638358205184:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 9350us (9556us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788748408.958749:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:3.0:1788748408.968251:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.968730:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205696 00000100:00100000:2.0:1788748408.968740:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205696 00000100:00100000:2.0:1788748408.968806:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748408.968816:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11601:x1875638358205696:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:2.0:1788748408.968832:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748408.968858:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7cd50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521958 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.968882:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.968887:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748408.968978:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358205696:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 163us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.968985:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788748408.971112:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748408.971255:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205824 00000100:00100000:1.0:1788748408.971264:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205824 00000100:00100000:1.0:1788748408.971320:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:1.0:1788748408.971330:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358205824:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:1.0:1788748408.971434:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.971450:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748408.971478:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748408.971641:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788748408.971723:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358205824:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 394us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.971731:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:1.0:1788748408.976628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748408.979483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358205952 00000100:00100000:2.0:1788748408.979498:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358205952 00000100:00100000:2.0:1788748408.979631:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:2.0:1788748408.979641:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+59:11601:x1875638358205952:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748408.979662:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748408.979682:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521989 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979735:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979747:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979765:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979777:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979802:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748408.979805:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748408.979809:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748408.979817:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2000, rc 0) 00000100:00100000:2.0:1788748408.979898:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11601:x1875638358205952:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 258us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748408.979905:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:2.0:1788748409.069368:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377064704:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.069412:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377064832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.069447:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.069448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.069503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377065216:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.069555:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377064960:0@lo:400:kworker.0 00000100:00100000:1.0:1788748409.069620:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377064704 00000100:00100000:1.0:1788748409.069628:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377064704 00000100:00100000:1.0:1788748409.069678:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788748409.069686:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377064704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073239:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.073414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065088:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.073479:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377065344 00000100:00100000:3.0:1788748409.073487:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377065344 00000100:00100000:3.0:1788748409.073526:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377065088 00000100:00100000:3.0:1788748409.073529:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377065088 00000100:00100000:3.0:1788748409.073561:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748409.073569:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377065344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073619:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875638377065344:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.073625:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748409.073640:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748409.073659:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073695:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377065088:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.073701:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788748409.073723:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748409.073745:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788748409.073750:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788748409.073770:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065088:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073795:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073845:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377064832 00000100:00100000:3.0:1788748409.073849:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377064832 00000100:00100000:3.0:1788748409.073876:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748409.073883:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377064832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.073930:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377064832:12345-0@lo:400:kworker.0 Request processed in 47us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.074074:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748409.074104:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377064832:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.078208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.078628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377064960 00000100:00100000:2.0:1788748409.078638:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377064960 00000100:00100000:2.0:1788748409.078702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788748409.078712:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377064960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.078781:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377064960:12345-0@lo:400:kworker.0 Request processed in 71us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.078788:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788748409.078829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377064960:0@lo:400:kworker.0 00000100:00080000:0.0:1788748409.078923:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748409.079867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.080036:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377065216 00000100:00100000:2.0:1788748409.080043:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377065216 00000100:00100000:2.0:1788748409.080114:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788748409.080123:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377065216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.080184:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377065216:12345-0@lo:400:kworker.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.080190:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788748409.080684:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748409.082368:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377065216:0@lo:400:kworker.0 00000100:00100000:1.0:1788748409.084189:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3308:x1875638377064704:12345-0@lo:400:kworker.0 Request processed in 14496us (14732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.084213:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788748409.084442:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3308:1875638377064704:0@lo:400:kworker.0 00000040:00080000:1.0:1788748409.133303:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748409.133313:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748409.133351:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788748409.133359:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748409.133472:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377065472:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748409.133623:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748409.140595:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefd962a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377065472:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748409.145176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.145486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358206080 00000100:00100000:2.0:1788748409.145497:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358206080 00000100:00100000:2.0:1788748409.145559:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:2.0:1788748409.145569:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11602:x1875638358206080:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748409.145610:0:5844:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748409.145831:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11602:x1875638358206080:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 261us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.145840:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00080000:0.0:1788748409.146404:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748409.153008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.153949:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358206208 00000100:00100000:2.0:1788748409.153960:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358206208 00000100:00100000:2.0:1788748409.154044:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:2.0:1788748409.154054:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11602:x1875638358206208:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788748409.154125:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154142:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154164:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154230:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154238:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154245:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154269:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154277:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154297:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748409.154336:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788748409.154340:0:8052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748409.154353:0:8052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154363:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154370:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154377:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154383:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.154387:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154393:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154405:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:2.0:1788748409.154408:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748409.154412:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154419:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154442:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154448:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154454:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154460:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.154463:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154468:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154476:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99cec6646700) 00010000:00010000:2.0:1788748409.154478:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748409.154481:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154486:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154501:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154507:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154513:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154523:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.154526:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154532:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154540:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748409.154542:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748409.154545:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.154551:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.154631:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11602:x1875638358206208:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 577us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.154639:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:1.0:1788748409.168767:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.169044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358206464 00000100:00100000:2.0:1788748409.169054:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358206464 00000100:00100000:2.0:1788748409.169119:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:2.0:1788748409.169130:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+60:11602:x1875638358206464:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748409.169151:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748409.169170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521990 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169258:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169291:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169312:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748409.169325:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788748409.169542:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169551:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169558:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169563:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.169567:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169575:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169586:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748409.169589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748409.169594:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169600:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169744:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce22 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521990 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169762:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:2.0:1788748409.169765:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748409.169770:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521990 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.169779:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748409.169838:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358206464:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 710us (1078us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788748409.169845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:0.0:1788748409.175405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.175659:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358206592 00000100:00100000:2.0:1788748409.175669:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358206592 00000100:00100000:2.0:1788748409.175726:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:2.0:1788748409.175736:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358206592:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748409.175773:0:8052:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748409.175873:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358206592:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 138us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.175881:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:1.0:1788748409.179452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.179867:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358206848 00000100:00100000:2.0:1788748409.179875:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358206848 00000100:00100000:2.0:1788748409.179942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:2.0:1788748409.179952:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358206848:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748409.179972:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748409.179975:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788748409.180000:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cdc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521974 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.180307:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748409.180324:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748409.180339:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521997 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748409.180895:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788748409.181746:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.181763:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.181775:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.181831:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521997 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.181848:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521997 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.181856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cec6646700) 00010000:00010000:2.0:1788748409.181859:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748409.181862:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2a00, rc 0) 00000100:00100000:2.0:1788748409.181946:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11602:x1875638358206848:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1994us (2502us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788748409.181954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:1.0:1788748409.198679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.198848:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358207104 00000100:00100000:2.0:1788748409.198858:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358207104 00000100:00100000:2.0:1788748409.198935:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:2.0:1788748409.198946:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11602:x1875638358207104:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748409.199003:0:8052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748409.199080:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7ce3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521997 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199100:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cec6646700) 00010000:00010000:2.0:1788748409.199111:0:8052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748409.199130:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199143:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199153:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199167:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199173:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199180:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199238:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199260:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199267:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199272:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.199276:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199283:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199291:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748409.199294:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748409.199297:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199303:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2200/0x5b377f42a7a7ce4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199312:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199316:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199322:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199326:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.199333:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199339:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199346:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x980d2ed2 (ffff99cec6646500) 00010000:00010000:2.0:1788748409.199349:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748409.199351:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.199356:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x980d2ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.199447:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358207104:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 502us (776us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748409.199455:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1788748409.212147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.212290:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358207232 00000100:00100000:3.0:1788748409.212311:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358207232 00000100:00100000:3.0:1788748409.212367:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:3.0:1788748409.212378:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+61:11602:x1875638358207232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.212422:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748409.212445:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee622652199e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212480:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212494:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212506:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212597:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212616:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.212625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:3.0:1788748409.212628:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748409.212632:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f800, rc 0) 00000100:00100000:3.0:1788748409.212695:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11602:x1875638358207232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 319us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.212703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:1.0:1788748409.219232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.219462:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358207488 00000100:00100000:2.0:1788748409.219472:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358207488 00000100:00100000:2.0:1788748409.219526:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:2.0:1788748409.219536:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+62:11602:x1875638358207488:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748409.219619:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.220163:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.220178:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748409.220443:0:8052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788748409.220465:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326263450247ns, next at 327263447557ns, rc = 0 00000004:00010000:2.0:1788748409.220553:0:8052:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005b6093fb reply state 00000000330c32d5 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.220563:0:8052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748409.222188:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11602:x1875638358207488:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2648us (2959us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788748409.222197:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00010000:00010000:3.0:1788748409.227942:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.227959:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.227983:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.227989:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748409.227994:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.228002:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.228056:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:3.0:1788748409.228060:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748409.228074:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.228081:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7ce68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.228574:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.230114:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358207616 00000100:00100000:3.0:1788748409.230128:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358207616 00000100:00100000:3.0:1788748409.230195:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:3.0:1788748409.230206:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+63:11602:x1875638358207616:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.230230:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748409.230248:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.230474:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.230508:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.230530:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:3.0:1788748409.230533:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748409.230536:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e600, rc 0) 00000100:00100000:3.0:1788748409.230649:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11602:x1875638358207616:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 444us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.230656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:1.0:1788748409.243141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.243228:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358207744 00000100:00100000:3.0:1788748409.243238:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358207744 00000100:00100000:3.0:1788748409.243334:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788748409.243343:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2347:x1875638358207744:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788748409.243626:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2347:x1875638358207744:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 284us (622us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788748409.243634:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00080000:0.0:1788748409.243841:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748409.246595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.246694:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208000 00000100:00100000:2.0:1788748409.246702:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208000 00000100:00100000:2.0:1788748409.246768:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788748409.246775:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+64:11602:x1875638358208000:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788748409.247102:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+65:11602:x1875638358208000:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 325us (515us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788748409.247110:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1788748409.252715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.252944:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208256 00000100:00100000:3.0:1788748409.252954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208256 00000100:00100000:3.0:1788748409.253011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:3.0:1788748409.253053:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+65:11602:x1875638358208256:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748409.253316:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+65:11602:x1875638358208256:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 263us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.253325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:1.0:1788748409.257579:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.257676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208384 00000100:00100000:3.0:1788748409.257700:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208384 00000100:00100000:3.0:1788748409.257811:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:3.0:1788748409.257821:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+65:11602:x1875638358208384:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.257843:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748409.257863:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7ce76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219ac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.257947:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.257963:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.257974:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748409.258011:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748409.262303:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.262360:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7ce76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ac expref: 67 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.262381:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ac expref: 66 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.262389:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:0.0:1788748409.262392:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748409.262396:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ee00, rc 0) 00000100:00100000:0.0:1788748409.262468:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+66:11602:x1875638358208384:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 4648us (4897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.262475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:3.0:1788748409.265713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748409.265809:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208512 00000100:00100000:1.0:1788748409.265819:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208512 00000100:00100000:1.0:1788748409.265880:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788748409.265891:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+10:2348:x1875638358208512:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748409.265920:0:8053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748409.265942:0:8053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219b3 expref: -99 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748409.265969:0:8053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e2278, blocks: 0x1 00010000:00010000:1.0:1788748409.265988:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1788748409.265993:0:8053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748409.266002:0:8053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 11 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.266040:0:8053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 11 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.266055:0:8053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748409.266115:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2348:x1875638358208512:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.266122:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788748409.270480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.270634:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208768 00000100:00100000:2.0:1788748409.270644:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208768 00000100:00100000:2.0:1788748409.270699:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:2.0:1788748409.270709:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+66:11602:x1875638358208768:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788748409.272985:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+66:11602:x1875638358208768:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 2267us (2503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.272999:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:2.0:1788748409.279571:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.279628:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358208896 00000100:00100000:3.0:1788748409.279638:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358208896 00000100:00100000:3.0:1788748409.279698:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788748409.279709:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:11602:x1875638358208896:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.279731:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748409.279750:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219ba expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.279783:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 12 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.279810:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748409.279815:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748409.279822:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.279856:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 12 pid: 8053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.279871:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 12 pid: 8053 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748409.279886:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875638377065600:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748409.279994:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748409.282940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748409.283326:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209024 00000100:00100000:1.0:1788748409.283336:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209024 00010000:00010000:1.0:1788748409.283377:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 13 pid: 8053 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.283437:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:1.0:1788748409.283448:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358209024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748409.283465:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788748409.283478:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875638377065600:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748409.283490:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 13 pid: 8053 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.283504:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 13 pid: 8053 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.283527:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.283673:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e000, rc 0) 00010000:00010000:1.0:1788748409.283691:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219b3 expref: 13 pid: 8053 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.283709:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748409.283714:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748409.283721:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.283731:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.283786:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:11602:x1875638358208896:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 4078us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.283794:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:1.0:1788748409.283842:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.283858:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875638377065728:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748409.285724:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748409.293262:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875638377065728:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788748409.293298:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748409.293391:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2347:x1875638358209024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 9944us (10459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.293401:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1788748409.294301:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.294394:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209152 00000100:00100000:0.0:1788748409.294402:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209152 00002000:00100000:0.0:1788748409.294447:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99cee5195880 x1875638358209152/t0(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:155/0 lens 504/0 e 0 to 0 dl 1788748420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748409.294458:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cee5195880 with x1875638358209152 ext(0->12) 00002000:00010000:0.0:1788748409.294463:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cee5195880 00000100:00100000:0.0:1788748409.294491:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748409.294500:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+11:2347:x1875638358209152:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788748409.295313:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2347:x1875638358209152:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 811us (1012us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788748409.295322:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00002000:00100000:0.0:1788748409.295329:0:6700:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99cee5195880 x1875638358209152/t4294967321(0) o4->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:155/0 lens 504/448 e 0 to 0 dl 1788748420 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748409.295338:0:6700:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cee5195880 with x1875638358209152 ext(0->12) 00002000:00010000:0.0:1788748409.295341:0:6700:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cee5195880 00000100:00100000:3.0:1788748409.299211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.299324:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209280 00000100:00100000:2.0:1788748409.299334:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209280 00000100:00100000:2.0:1788748409.299401:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:2.0:1788748409.299411:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+66:11602:x1875638358209280:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788748409.372675:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:1.0:1788748409.372698:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788748409.372721:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cec4930000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788748409.372726:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec319cf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cec4930480 00000020:00080000:1.0:1788748409.372730:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec319c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cecdc51000 00000001:00080000:1.0:1788748409.372761:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788748409.372767:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788748409.372784:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788748409.372796:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cefd99ac00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788748409.372799:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ceed631d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cefd99aa80 00000020:00080000:1.0:1788748409.372802:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ceed631b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cefb7e6800 00000020:00080000:1.0:1788748409.372826:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788748409.373477:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1788748409.373928:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11602:x1875638358209280:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 74512us (74720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.373938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000020:00080000:1.0:1788748409.374144:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788748409.374164:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788748409.374224:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.374283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748409.374290:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788748409.377618:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.377658:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377065984 00000100:00100000:3.0:1788748409.377680:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377065984 00000100:00100000:3.0:1788748409.377731:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209408 00000100:00100000:3.0:1788748409.377735:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209408 00000100:00100000:3.0:1788748409.377758:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748409.377766:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef68fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377065984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788748409.377981:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788748409.377986:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788748408 00002000:00010000:3.0:1788748409.378003:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788748409.378005:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788748408 -> 1788748408 00002000:00010000:3.0:1788748409.378008:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788748409.378094:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef68fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377065984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 327us (3869us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788748409.378102:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748409.378249:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1788748409.378258:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+13:2348:x1875638358209408:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788748409.379326:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377066112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788748409.379496:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.379584:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.379610:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377066112 00000100:00100000:1.0:1788748409.379617:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377066112 00000100:00100000:1.0:1788748409.379643:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377065856 00000100:00100000:1.0:1788748409.379645:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377065856 00000100:00100000:1.0:1788748409.379657:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748409.379663:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377066112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788748409.380083:0:6695:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788748409.380116:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e2277, atime: 0x6a9e2277, ctime: 0x6a9e2277, blocks: 0x1 00010000:00010000:1.0:1788748409.380124:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.380141:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1788748409.380146:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748409.380152:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.380168:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.380177:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.380185:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.380203:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788748409.382606:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377066112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2933us (3214us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788748409.382621:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748409.382664:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748409.382747:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377065856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788748409.382778:0:6695:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788748409.382804:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.382825:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 13 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.382834:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788748409.382839:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748409.382843:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383091:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 13 pid: 8053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383107:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 13 pid: 8053 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.383123:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377066240:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748409.383466:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd3d8300 going to sleep for 11 seconds 00010000:00010000:1.0:1788748409.383487:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748409.383505:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383514:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748409.383518:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383529:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383548:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383555:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7ce92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.383575:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748409.383577:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748409.383578:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788748409.387186:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cee52e2a00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788748409.387202:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788748409.387713:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cee52e1880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788748409.387721:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377066112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748409.394049:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.394088:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209536 00000100:00100000:2.0:1788748409.394097:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209536 00010000:00010000:2.0:1788748409.394139:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 14 pid: 8053 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.394188:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:2.0:1788748409.394198:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2348:x1875638358209536:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748409.394212:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748409.394217:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 14 pid: 8053 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.394232:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 14 pid: 8053 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.394270:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748409.394276:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748409.394282:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.394292:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.394504:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748409.394552:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+14:2348:x1875638358209536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 355us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.394561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00010000:00010000:0.0:1788748409.394693:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7cc54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521919 expref: 13 pid: 8053 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.394709:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377066240:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748409.394730:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.394740:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.394747:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.394757:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.394776:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.394799:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748409.395994:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748409.396005:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.396038:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748409.396043:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.396053:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.396070:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.396091:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b8e366d/0x5b377f42a7a7ce99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.396111:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748409.396113:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748409.396114:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748409.398445:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875638377065856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15697us (18854us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788748409.398460:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:1.0:1788748409.404689:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cee52e3480/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788748409.404704:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377065856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788748409.467337:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+12:2348:x1875638358209408:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 89068us (89716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.467350:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000001:00080000:1.0:1788748409.470330:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788748409.470361:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1788748409.472634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.472980:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209792 00000100:00100000:3.0:1788748409.472992:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209792 00000100:00100000:3.0:1788748409.473085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:3.0:1788748409.473096:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11602:x1875638358209792:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.473148:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748409.473453:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7ce7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ac expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.473474:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:3.0:1788748409.473479:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748409.473570:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.473586:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.473597:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748409.473917:0:5845:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002e2de80f reply state 0000000098cad301 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.473927:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748409.474058:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:11602:x1875638358209792:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 963us (1433us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788748409.474066:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:3.0:1788748409.477875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1788748409.477949:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.477962:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.477988:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.477994:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748409.477999:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.478007:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.478045:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:1.0:1788748409.478049:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748409.478054:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.478061:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7cea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.478865:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358209920 00000100:00100000:1.0:1788748409.478876:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358209920 00000100:00100000:1.0:1788748409.478940:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1788748409.478951:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2350:x1875638358209920:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788748409.479191:0:8053:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788748409.479195:0:8053:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788748408 -> 1788748408 00002000:00010000:1.0:1788748409.479197:0:8053:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788748407 00002000:00010000:1.0:1788748409.479199:0:8053:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788748408 -> 1788748408 00002000:00010000:1.0:1788748409.479201:0:8053:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788748409.479450:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2350:x1875638358209920:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 499us (1582us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788748409.479467:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1788748409.482452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.482576:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210176 00000100:00100000:0.0:1788748409.482586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210176 00000100:00100000:0.0:1788748409.482642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:0.0:1788748409.482653:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11602:x1875638358210176:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788748409.482728:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.482744:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.482753:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.482787:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.482801:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 20 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.482814:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377066368:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748409.482912:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748409.486705:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875638377066368:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748409.486735:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.487355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.487986:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210304 00000100:00100000:3.0:1788748409.487996:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210304 00010000:00010000:0.0:1788748409.488547:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.488633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:0.0:1788748409.488645:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:2348:x1875638358210304:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748409.488660:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748409.488746:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488760:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488782:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f800/0x5b377f42a7a7ce61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee622652199e expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488796:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:0.0:1788748409.488801:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488810:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488816:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.488847:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748409.488944:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:2348:x1875638358210304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 301us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.488963:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00010000:00010000:2.0:1788748409.489042:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489052:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489079:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489086:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489092:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489098:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748409.489102:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489110:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489130:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:2.0:1788748409.489133:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788748409.489137:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.489143:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7cea7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.489203:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11602:x1875638358210176:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 6551us (6760us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788748409.489211:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:0.0:1788748409.496957:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748409.497207:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210432 00000100:00100000:1.0:1788748409.497217:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210432 00000100:00100000:1.0:1788748409.497631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:1.0:1788748409.497645:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358210432:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748409.506462:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.506493:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.506503:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748409.506508:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748409.506513:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.506552:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.506571:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 8 pid: 6696 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.506587:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377066496:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748409.506853:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedea36240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748409.524046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.524918:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210560 00000100:00100000:3.0:1788748409.524928:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210560 00010000:00010000:3.0:1788748409.524971:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 9 pid: 6696 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748409.525049:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788748409.525060:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358210560:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748409.525075:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748409.525096:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 9 pid: 6696 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.525109:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 9 pid: 6696 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.525134:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748409.525139:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748409.525144:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.525153:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.525173:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748409.525222:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+9:2348:x1875638358210560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 165us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.525229:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00010000:00010000:0.0:1788748409.529302:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7ce8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219ba expref: 8 pid: 6696 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.529460:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875638377066496:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748409.529488:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529501:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529509:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529545:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529555:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529563:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529570:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748409.529591:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529600:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529619:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.529627:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1da8384/0x5b377f42a7a7ceae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.531953:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2347:x1875638358210432:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 34301us (34994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.531968:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1788748409.549220:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.549316:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210816 00000100:00100000:3.0:1788748409.549339:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210816 00000100:00100000:3.0:1788748409.549403:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:3.0:1788748409.549413:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11602:x1875638358210816:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788748409.549489:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549507:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549519:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549729:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549741:0:8052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549750:0:8052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549781:0:8052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.549795:0:8052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 20 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748409.549810:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377066624:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748409.549889:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2be19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748409.554076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748409.555317:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358210944 00000100:00100000:1.0:1788748409.555343:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358210944 00010000:00010000:1.0:1788748409.555402:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.555448:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:1.0:1788748409.555458:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:2347:x1875638358210944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748409.555474:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748409.555480:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.555493:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.555516:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:1.0:1788748409.555521:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.555530:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.555538:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748409.555558:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748409.555624:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:2347:x1875638358210944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 167us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.555631:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00010000:00010000:2.0:1788748409.560961:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e600/0x5b377f42a7a7ce6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219a5 expref: 20 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748409.560989:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377066624:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748409.561088:0:8052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.561100:0:8052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.561106:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748409.561796:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788748409.562255:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788748409.562477:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788748409.562598:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377066752:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788748409.562670:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.562819:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3cb86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748409.565310:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377066752 00000100:00100000:3.0:1788748409.565325:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377066752 00000100:00100000:2.0:1788748409.567499:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748409.567515:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8052:x1875638377066752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788748409.567650:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8052:x1875638377066752:12345-0@lo:1000:mdt00_003.0 Request processed in 139us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.567658:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748409.567740:0:8052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788748409.567746:0:8052:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cee52e2a00, transno 4294967322 00000100:00100000:3.0:1788748409.567768:0:8052:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99cee52e3480 x1875638377065856/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788748425 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748409.567780:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377066752:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788748409.568318:0:8052:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788748409.569678:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377066880:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788748409.569743:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.570667:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2be19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748409.570863:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377066880 00000100:00100000:0.0:1788748409.570872:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377066880 00000100:00100000:0.0:1788748409.570926:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748409.570936:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8052:x1875638377066880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788748409.571369:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8052:x1875638377066880:12345-0@lo:1000:mdt00_003.0 Request processed in 433us (1624us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788748409.571499:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748409.571607:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8052:1875638377066880:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788748409.571645:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571656:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571664:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571670:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ee00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748409.571674:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571681:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571695:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cece6d7900) 00010000:00010000:3.0:1788748409.571711:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748409.571718:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571724:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cebc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571756:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571762:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571768:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571773:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748409.571776:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571781:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571789:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:3.0:1788748409.571791:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748409.571798:0:8052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571809:0:8052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571817:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.571855:0:8052:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748409.571868:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377067008:192.168.203.4@tcp:105: 00000100:00100000:3.0:1788748409.571995:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2be19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748409.578638:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.578833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358211072 00000100:00100000:2.0:1788748409.578842:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358211072 00000100:00100000:2.0:1788748409.578902:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1788748409.578922:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11601:x1875638358211072:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:2.0:1788748409.579078:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+24:11601:x1875638358211072:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 157us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.579084:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1788748409.581620:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748409.581641:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377067136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748409.581706:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.581806:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377067136 00000100:00100000:2.0:1788748409.581813:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377067136 00000100:00100000:2.0:1788748409.581866:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748409.581876:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377067136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748409.581897:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748409.581952:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377067136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.581959:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748409.582070:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377067136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748409.583785:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8052:1875638377067008:192.168.203.4@tcp:105: 00010000:00010000:3.0:1788748409.583821:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.583833:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7cdff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584049:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584080:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584091:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584102:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584107:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584220:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584227:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748409.584231:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584239:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584251:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748409.584254:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748409.584258:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584264:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7cec3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584274:0:8052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584287:0:8052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584292:0:8052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584309:0:8052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ea00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748409.584313:0:8052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584319:0:8052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584327:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748409.584330:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748409.584333:0:8052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.584338:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ea00/0x5b377f42a7a7ceb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.584671:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11602:x1875638358210816:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 35257us (35457us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788748409.584682:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000020:00080000:0.0:1788748409.584687:0:8052:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788748409.584759:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.584787:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358211328 00000100:00100000:0.0:1788748409.584793:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358211328 00000100:00100000:0.0:1788748409.584828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:0.0:1788748409.584837:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11601:x1875638358211328:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:0.0:1788748409.589562:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788748409.589664:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11601:x1875638358211328:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 4822us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.589675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000040:00080000:0.0:1788748409.590519:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748409.590526:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748409.590576:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788748409.590583:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788748409.590692:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377067264:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788748409.590764:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748409.625045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.625175:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1875638377067264:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748409.625370:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358211584 00000100:00100000:2.0:1788748409.625378:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358211584 00000100:00100000:2.0:1788748409.625439:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1788748409.625449:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:11602:x1875638358211584:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788748409.626104:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788748409.626214:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788748409.626269:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626286:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626298:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626307:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626314:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626321:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748409.626455:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788748409.626545:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:11602:x1875638358211584:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1096us (1541us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788748409.626555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000020:00080000:2.0:1788748409.626560:0:5847:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748409.633065:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748409.633079:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.633091:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748409.633096:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.633106:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.633123:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cec6646900) 00010000:00010000:3.0:1788748409.633126:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748409.633132:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.633137:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7ceca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.633188:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748409.633190:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748409.633192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748409.633367:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748409.633627:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358211712 00000100:00100000:2.0:1788748409.633636:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358211712 00000100:00100000:2.0:1788748409.633694:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:2.0:1788748409.633703:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:11604:x1875638358211712:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748409.633734:0:5845:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748409.633838:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:11604:x1875638358211712:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 134us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.633845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:1.0:1788748409.642583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.642680:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358211968 00000100:00100000:0.0:1788748409.642690:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358211968 00000100:00100000:0.0:1788748409.642750:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:0.0:1788748409.642762:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+25:11604:x1875638358211968:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748409.642786:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748409.642807:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7ced1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219c1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.642902:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7ced8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.642925:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.642938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748409.642969:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788748409.643131:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7ced1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c1 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.643151:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7ced8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c1 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.643158:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748409.643161:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748409.643165:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5c00, rc 0) 00000100:00100000:0.0:1788748409.643224:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:11604:x1875638358211968:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 465us (652us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788748409.643232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:3.0:1788748409.646358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.646501:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358212096 00000100:00100000:0.0:1788748409.646510:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358212096 00000100:00100000:0.0:1788748409.646575:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:0.0:1788748409.646586:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+27:11605:x1875638358212096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748409.646605:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748409.646624:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7cee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219c8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646685:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646727:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646742:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646750:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.646756:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.647000:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.647045:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.647055:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.647090:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.647104:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 28 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.649523:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377067392:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748409.651362:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed731300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748409.660926:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875638377067392:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748409.660959:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748409.663467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748409.664476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.664581:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358212608 00000100:00100000:0.0:1788748409.664591:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358212608 00000100:00100000:0.0:1788748409.664651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:0.0:1788748409.664661:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+29:11604:x1875638358212608:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788748409.664739:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.664756:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.664767:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.664990:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.664999:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.665006:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.665037:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748409.665042:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.665050:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.665070:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748409.665072:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748409.665078:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.665085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d600/0x5b377f42a7a7cf02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748409.665235:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:11604:x1875638358212608:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 575us (762us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788748409.665244:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000040:00080000:0.0:1788748409.665349:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748409.665354:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748409.665849:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788748409.665857:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748409.667390:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358212352 00000100:00100000:2.0:1788748409.667402:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358212352 00000100:00100000:2.0:1788748409.667462:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1788748409.667471:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:5589:x1875638358212352:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788748409.667753:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:5589:x1875638358212352:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 281us (4293us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788748409.667761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788748409.675557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748409.675791:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358212864 00000100:00100000:0.0:1788748409.675800:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358212864 00000100:00100000:0.0:1788748409.675846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1788748409.675856:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:11604:x1875638358212864:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748409.676135:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11604:x1875638358212864:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 279us (586us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788748409.676143:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1788748409.678613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748409.678778:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358212992 00000100:00100000:3.0:1788748409.678787:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358212992 00010000:00010000:3.0:1788748409.678826:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 32 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748409.678875:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1788748409.678885:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:2347:x1875638358212992:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748409.678898:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748409.678914:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 32 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.678928:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 32 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.678948:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7cdf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521982 expref: 32 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.678963:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:3.0:1788748409.678968:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.678977:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.678998:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748409.679062:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748409.679110:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+31:2347:x1875638358212992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 227us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.679117:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00010000:00010000:0.0:1788748409.679684:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679695:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748409.679750:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788748409.679754:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748409.679773:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679786:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679795:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679802:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679808:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679814:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748409.679818:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679825:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679835:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:0.0:1788748409.679838:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748409.679843:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.679849:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7ceed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680457:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680467:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680473:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680478:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748409.680481:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680487:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680497:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cec3e09f00) 00010000:00010000:0.0:1788748409.680500:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748409.680504:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680510:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7cef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680662:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7cee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c8 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680678:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c8 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748409.680698:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:0.0:1788748409.680700:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748409.680703:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c200, rc 0) 00000100:00100000:2.0:1788748409.682669:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:11605:x1875638358212096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 36075us (36310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.682681:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 233 00010000:00010000:2.0:1788748409.966956:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748410.101108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377067520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748410.101181:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748410.101598:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377067520 00000100:00100000:0.0:1788748410.101606:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377067520 00000100:00100000:0.0:1788748410.101654:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788748410.101662:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377067520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748410.101684:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1788748410.101735:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377067520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748410.101742:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788748410.102319:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377067520:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788748410.653622:0:12512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748410.653632:0:12512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748410.653676:0:12512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788748410.653682:0:12512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748410.909607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748410.911272:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213248 00000100:00100000:3.0:1788748410.911289:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213248 00000100:00100000:3.0:1788748410.911373:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:3.0:1788748410.911384:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+30:11629:x1875638358213248:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748410.911408:0:8052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748410.911427:0:8052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219cf expref: -99 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.911528:0:8052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7cf10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.911544:0:8052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7cf10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.911556:0:8052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7cf10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748410.911567:0:8052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788748410.911694:0:8052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219cf expref: 33 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.911714:0:8052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7cf10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219cf expref: 32 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.911736:0:8052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:3.0:1788748410.911739:0:8052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788748410.911743:0:8052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fc00, rc 0) 00000100:00100000:3.0:1788748410.911805:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11629:x1875638358213248:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 423us (2206us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788748410.911812:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:3.0:1788748410.916442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748410.916476:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213376 00000100:00100000:3.0:1788748410.916484:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213376 00000100:00100000:3.0:1788748410.916530:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:3.0:1788748410.916539:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11629:x1875638358213376:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1788748410.916603:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916620:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916633:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916659:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916667:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916674:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916691:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748410.916697:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916704:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916716:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:3.0:1788748410.916719:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748410.916723:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748410.916729:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f600/0x5b377f42a7a7cf1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748410.916795:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:11629:x1875638358213376:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 257us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748410.916803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00010000:00010000:3.0:1788748410.993268:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748411.079668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748411.083069:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213504 00000100:00100000:0.0:1788748411.083084:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213504 00000100:00100000:0.0:1788748411.083177:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1788748411.083190:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358213504:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748411.083207:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748411.083229:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6a756d/0x5b377f42a7a7cf25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219d6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748411.083256:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e2278, atime: 0x6a9e2277, ctime: 0x6a9e2278, blocks: 0xb 00000100:00080000:3.0:1788748411.083258:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788748411.083275:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788748411.083292:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748411.083302:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6a756d/0x5b377f42a7a7cf25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219d6 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748411.083321:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb6a756d/0x5b377f42a7a7cf25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219d6 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748411.083344:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d600, rc 0) 00000100:00100000:0.0:1788748411.083415:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358213504:12345-192.168.203.4@tcp:101:cat.0 Request processed in 229us (3757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748411.083422:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1788748411.090909:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748411.090971:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213632 00000100:00100000:1.0:1788748411.090981:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213632 00002000:00100000:1.0:1788748411.091077:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99cee5197b80 x1875638358213632/t0(0) o3->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:157/0 lens 488/0 e 0 to 0 dl 1788748422 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748411.091089:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cee5197b80 with x1875638358213632 ext(0->4095) 00002000:00010000:1.0:1788748411.091095:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cee5197b80 00000100:00100000:1.0:1788748411.091127:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748411.091148:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358213632:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:1.0:1788748411.091361:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2347:x1875638358213632:12345-192.168.203.4@tcp:3:cat.0 Request processed in 224us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788748411.091369:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00002000:00100000:1.0:1788748411.091376:0:6702:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99cee5197b80 x1875638358213632/t0(0) o3->7b6e58be-3dc9-4518-a85f-e723d86d70a3@192.168.203.4@tcp:157/0 lens 488/4536 e 0 to 0 dl 1788748422 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748411.091384:0:6702:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff99cee5197b80 with x1875638358213632 ext(0->4095) 00002000:00010000:1.0:1788748411.091387:0:6702:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cee5197b80 00010000:00010000:3.0:1788748412.015821:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748412.971533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748412.971584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748412.971631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748412.971666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748412.971688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213760 00000100:00100000:3.0:1788748412.971697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748412.971710:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213760 00000100:00100000:3.0:1788748412.971744:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214016 00000100:00100000:3.0:1788748412.971772:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214016 00000100:00100000:0.0:1788748412.971794:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:0.0:1788748412.971818:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358213760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748412.971829:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214144 00000100:00100000:3.0:1788748412.971835:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214144 00000100:00100000:3.0:1788748412.971879:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1788748412.971906:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358214016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748412.971922:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+13:2348:x1875638358213760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 114us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748412.971931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:3.0:1788748412.971974:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+8:2348:x1875638358214016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748412.971986:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788748412.972049:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214272 00000100:00100000:1.0:1788748412.972054:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214272 00000100:00100000:1.0:1788748412.972107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358213888 00000100:00100000:1.0:1788748412.972111:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358213888 00000100:00100000:1.0:1788748412.972135:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:1.0:1788748412.972144:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358214272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748412.972184:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1788748412.972188:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2348:x1875638358214272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748412.972197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00080000:3.0:1788748412.972219:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748412.972225:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00080000:3.0:1788748412.972228:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748412.972240:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:2348:x1875638358213888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748412.972275:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+32:2348:x1875638358213888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748412.972281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:1.0:1788748412.973359:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358214144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748412.973417:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2348:x1875638358214144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 964us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748412.973424:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00010000:00010000:2.0:1788748413.037244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748413.227988:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788748413.228002:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1788748414.068211:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748414.189258:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748414.190227:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377067776:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.190297:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.190353:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748414.190359:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377067904:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.190381:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.190420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377067776 00000100:00100000:2.0:1788748414.190427:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377067776 00000100:00100000:2.0:1788748414.190470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377067904 00000100:00100000:2.0:1788748414.190473:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377067904 00000100:00100000:2.0:1788748414.190503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788748414.190512:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377067776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.190562:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377067776:12345-0@lo:400:kworker.0 Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.190569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788748414.190588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788748414.190606:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377067904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.190636:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377067904:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.190642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788748414.190676:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748414.190706:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377067904:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.190715:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.197198:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377067648:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197223:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.197262:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068032 00000100:00100000:3.0:1788748414.197270:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068032 00000100:00100000:3.0:1788748414.197323:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748414.197331:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197384:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377068032:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748414.197391:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748414.197414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377067648 00000100:00100000:3.0:1788748414.197418:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377067648 00000100:00100000:3.0:1788748414.197442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788748414.197449:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377067648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197492:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377067648:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748414.197498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1788748414.197529:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748414.197557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.197566:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377067648:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.204145:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748414.204166:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377068288:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.204225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748414.204266:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068288 00000100:00100000:1.0:1788748414.204273:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068288 00000100:00100000:1.0:1788748414.204318:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788748414.204326:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377068288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.204380:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377068288:12345-0@lo:400:kworker.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748414.204388:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788748414.204428:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788748414.204444:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788748414.204462:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cee52e1880, transno 4294967310 00000100:00100000:1.0:1788748414.204473:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.206777:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.206840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748414.206906:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748414.207213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068160 00000100:00100000:1.0:1788748414.207221:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068160 00000100:00100000:1.0:1788748414.207286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788748414.207295:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377068160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.207345:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377068160:12345-0@lo:400:kworker.0 Request processed in 52us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748414.207352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1788748414.207397:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748414.207426:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.702080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748414.702103:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377068416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748414.702179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.702250:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068416 00000100:00100000:3.0:1788748414.702257:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068416 00000100:00100000:3.0:1788748414.702299:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748414.702307:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377068416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748414.702339:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748414.702393:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefdaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377068416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748414.702400:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748414.702440:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377068416:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788748414.765766:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788748414.765785:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788748414.779227:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788748414.779267:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788748414.779297:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788748414.779305:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ced2be1780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788748414.779310:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cede8fec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ced2be1e40 00000020:00080000:3.0:1788748414.779313:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cede8fe000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cefdae1800 00000020:00080000:1.0:1788748414.779367:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788748414.779569:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788748415.085454:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748415.214035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377068544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748415.214105:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748415.214936:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068544 00000100:00100000:0.0:1788748415.214947:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068544 00000100:00100000:0.0:1788748415.215005:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748415.215037:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377068544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748415.215077:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748415.215166:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377068544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748415.215173:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748415.215281:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788748415.215287:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cee52e3480, transno 4294967323 00000004:00080000:3.0:1788748415.215304:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788748415.215336:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377068544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748416.111294:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748416.408511:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748416.408732:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214400 00000100:00100000:2.0:1788748416.408742:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214400 00000100:00100000:2.0:1788748416.408833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:2.0:1788748416.408846:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11289:x1875638358214400:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788748416.408957:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11289:x1875638358214400:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 115us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748416.408964:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00080000:3.0:1788748416.409459:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748416.417996:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748416.418238:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214656 00000100:00100000:1.0:1788748416.418249:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214656 00000100:00100000:1.0:1788748416.418305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1788748416.418316:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:11289:x1875638358214656:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748416.418645:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:11289:x1875638358214656:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 329us (657us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788748416.418653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:3.0:1788748417.134359:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748417.837567:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748417.837578:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748417.837623:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788748417.837994:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748418.083841:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748418.083904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748418.083991:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748418.084039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748418.084069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748418.084165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214784 00000100:00100000:2.0:1788748418.084175:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214784 00000100:00100000:2.0:1788748418.084244:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:2.0:1788748418.084255:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358214784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748418.084324:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2349:x1875638358214784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748418.084333:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:1.0:1788748418.085381:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215296 00000100:00100000:1.0:1788748418.085389:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215296 00000100:00100000:1.0:1788748418.085431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358214912 00000100:00100000:1.0:1788748418.085433:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358214912 00000100:00100000:1.0:1788748418.085473:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:1.0:1788748418.085482:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358215296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748418.085532:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:2349:x1875638358215296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748418.085539:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:1.0:1788748418.085553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:1.0:1788748418.085558:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:2349:x1875638358214912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748418.085582:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:2349:x1875638358214912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748418.085588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00080000:1.0:1788748418.085604:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748418.086300:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215040 00000100:00100000:0.0:1788748418.086307:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215040 00000100:00100000:0.0:1788748418.086421:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215168 00000100:00100000:0.0:1788748418.086425:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215168 00000100:00100000:2.0:1788748418.086552:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1788748418.086563:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2349:x1875638358215040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748418.086605:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2349:x1875638358215040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748418.086632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00080000:1.0:1788748418.087626:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748418.087632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748418.087982:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:0.0:1788748418.087993:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358215168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748418.088062:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2349:x1875638358215168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (3992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748418.088070:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00010000:00010000:3.0:1788748418.158292:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748418.455414:0:12713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:33:36 (1788748416) 00010000:00010000:3.0:1788748419.181363:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748419.310272:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377068928:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.310938:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748419.311073:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377069184:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311101:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748419.311129:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748419.311136:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377069056:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.311151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748419.311171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.311181:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788748419.311217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068672 00000100:00100000:3.0:1788748419.311233:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068672 00000100:00100000:1.0:1788748419.311259:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788748419.311288:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.311291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.311325:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311349:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377068672:12345-0@lo:400:kworker.0 Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.311357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788748419.311372:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748419.311395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069184 00000100:00100000:3.0:1788748419.311401:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069184 00000100:00100000:1.0:1788748419.311412:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068928 00000100:00100000:1.0:1788748419.311418:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068928 00000100:00100000:3.0:1788748419.311438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377068800 00000100:00100000:3.0:1788748419.311443:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377068800 00000100:00100000:1.0:1788748419.311451:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788748419.311465:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788748419.311472:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377068928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311505:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377068928:12345-0@lo:400:kworker.0 Request processed in 34us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.311511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788748419.311522:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788748419.311527:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377068800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.311551:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377068800:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.311556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788748419.311573:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069056 00000100:00100000:3.0:1788748419.311576:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069056 00000100:00100000:1.0:1788748419.311782:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377069184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.311819:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377069184:12345-0@lo:400:kworker.0 Request processed in 361us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.311826:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748419.311865:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748419.311874:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.311906:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377069056:12345-0@lo:400:kworker.0 Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.311913:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788748419.312945:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069312 00000100:00100000:3.0:1788748419.312954:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069312 00000100:00100000:3.0:1788748419.313010:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748419.313033:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313082:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377069312:12345-0@lo:400:kworker.0 Request processed in 52us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.313094:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788748419.313117:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748419.313121:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748419.313123:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748419.313159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377069056:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313170:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313179:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377069184:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313218:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313228:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee52e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.313237:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377068928:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.826668:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377069440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748419.826789:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748419.826859:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069440 00000100:00100000:0.0:1788748419.826873:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069440 00000100:00100000:0.0:1788748419.826948:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748419.826958:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef689b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377069440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748419.826992:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748419.827109:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef689b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377069440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748419.827117:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748419.827183:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377069440:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788748419.890223:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788748419.890243:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788748419.890371:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788748419.890384:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788748420.205284:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748420.337439:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748420.337470:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377069568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748420.337659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748420.337725:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069568 00000100:00100000:0.0:1788748420.337733:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069568 00000100:00100000:0.0:1788748420.337786:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748420.337795:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377069568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748420.338308:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748420.338373:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377069568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 579us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748420.338381:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748420.338458:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377069568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748420.631936:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748420.632060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215424 00000100:00100000:3.0:1788748420.632071:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215424 00000100:00100000:3.0:1788748420.632148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1788748420.632158:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+5:12293:x1875638358215424:12345-192.168.203.4@tcp:101:lsof.0 00010000:00010000:3.0:1788748420.632177:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748420.632196:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7cf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219dd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632280:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632293:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632305:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748420.632350:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748420.632354:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748420.632393:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632419:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e800/0x5b377f42a7a7cf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219dd expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632435:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219dd expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748420.632443:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:3.0:1788748420.632446:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748420.632462:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ee00, rc 0) 00000100:00100000:3.0:1788748420.632527:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:12293:x1875638358215424:12345-192.168.203.4@tcp:101:lsof.0 Request processed in 370us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748420.632534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00080000:1.0:1788748420.632811:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748421.230222:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748421.977847:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748421.977923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215680 00000100:00100000:0.0:1788748421.977934:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215680 00000100:00100000:0.0:1788748421.978053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:0.0:1788748421.978063:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+19:12295:x1875638358215680:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:0.0:1788748421.978424:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:12295:x1875638358215680:12345-192.168.203.4@tcp:35:umount.0 Request processed in 361us (586us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788748421.978431:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00080000:1.0:1788748421.978599:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748421.980914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748421.981584:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358215936 00000100:00100000:0.0:1788748421.981595:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358215936 00000100:00100000:0.0:1788748421.982274:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1788748421.982288:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+20:12295:x1875638358215936:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:0.0:1788748421.982674:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:12295:x1875638358215936:12345-192.168.203.4@tcp:35:umount.0 Request processed in 388us (1765us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788748421.982682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1788748421.988457:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748421.988805:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216192 00000100:00100000:2.0:1788748421.988816:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216192 00000100:00100000:2.0:1788748421.988882:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1788748421.988892:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec45a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+21:12295:x1875638358216192:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:2.0:1788748421.989689:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec45a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:12295:x1875638358216192:12345-192.168.203.4@tcp:35:umount.0 Request processed in 796us (1238us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788748421.989699:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1788748421.993834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748421.994140:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216448 00000100:00100000:0.0:1788748421.994150:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216448 00000100:00100000:0.0:1788748421.994214:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788748421.994224:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:12295:x1875638358216448:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:0.0:1788748421.994549:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:12295:x1875638358216448:12345-192.168.203.4@tcp:35:umount.0 Request processed in 326us (736us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788748421.994557:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788748422.000348:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748422.000382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748422.000412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748422.000676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216576 00000100:00100000:2.0:1788748422.000686:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216576 00000100:00100000:3.0:1788748422.000810:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216832 00000100:00100000:3.0:1788748422.000842:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216832 00000100:00100000:3.0:1788748422.000882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216704 00000100:00100000:3.0:1788748422.000886:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216704 00000100:00100000:2.0:1788748422.000889:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788748422.000904:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+15:2350:x1875638358216576:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788748422.000912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:2.0:1788748422.000922:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788748422.000923:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+15:2350:x1875638358216832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748422.000936:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748422.000947:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d400/0x5b377f42a7a7bfb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652156f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748422.000950:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7c1cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652163a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.000977:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748422.000987:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748422.001059:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+13:2350:x1875638358216832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748422.001067:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788748422.001088:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788748422.001095:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+12:2350:x1875638358216704:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748422.001103:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748422.001113:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7bf1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521537 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748422.001124:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748422.001144:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62c24351-d204-4cbb-bccb-959b10d053e2+11:2350:x1875638358216704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 50us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748422.001151:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788748422.001668:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2350:x1875638358216576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 767us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748422.001678:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788748422.004153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748422.004239:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358216960 00000100:00100000:1.0:1788748422.004248:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358216960 00000100:00100000:1.0:1788748422.004323:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1788748422.004334:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+5:2346:x1875638358216960:12345-192.168.203.4@tcp:9:umount.0 00000100:00080000:3.0:1788748422.004356:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788748422.004369:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c291 00000100:00080000:1.0:1788748422.004378:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cee52fa800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788748422.004400:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788748422.004414:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788748422.004665:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6e58be-3dc9-4518-a85f-e723d86d70a3+2:2346:x1875638358216960:12345-192.168.203.4@tcp:9:umount.0 Request processed in 332us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748422.004672:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:3.0:1788748422.007970:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748422.008113:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358217344 00000100:00100000:0.0:1788748422.008260:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358217344 00000100:00100000:0.0:1788748422.008343:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:0.0:1788748422.008355:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+7:2346:x1875638358217344:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:0.0:1788748422.008385:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c4f2 00000020:00010000:0.0:1788748422.008393:0:6697:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cee516e000: total 0 00000100:00080000:0.0:1788748422.008398:0:6697:0:(import.c:65:import_set_state_nolock()) ffff99cee516f800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788748422.008404:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1788748422.008430:0:6710:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cee516e000: total 0 00000001:00000004:0.0:1788748422.008443:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:2.0:1788748422.008461:0:6710:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cee516e000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788748422.008510:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6a756d/0x5b377f42a7a7cf25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219d6 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.008544:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f07c50/0x5b377f42a7a7c895 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652180f expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.008557:0:6710:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cee516e000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788748422.008567:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748422.008569:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748422.008571:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748422.008785:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6e58be-3dc9-4518-a85f-e723d86d70a3+2:2346:x1875638358217344:12345-192.168.203.4@tcp:9:umount.0 Request processed in 431us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748422.008794:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1788748422.015616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748422.015726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358218368 00000100:00100000:1.0:1788748422.015734:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358218368 00000100:00100000:1.0:1788748422.015776:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:1.0:1788748422.015784:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+23:2346:x1875638358218368:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:1.0:1788748422.015812:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bf2d 00000020:00010000:1.0:1788748422.015836:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cefd78c800: total 0 00000100:00080000:1.0:1788748422.015845:0:5845:0:(import.c:65:import_set_state_nolock()) ffff99cefd78f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748422.015912:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788748422.016499:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6e58be-3dc9-4518-a85f-e723d86d70a3+22:2346:x1875638358218368:12345-192.168.203.4@tcp:39:umount.0 Request processed in 712us (887us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788748422.016509:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00000020:00010000:2.0:1788748422.016980:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cefd78c800: total 0 00010000:00010000:2.0:1788748422.017167:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cefd78c800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788748422.017205:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748422.017210:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748422.017218:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7c856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217fa expref: 21 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017396:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748422.017400:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748422.017406:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4200/0x5b377f42a7a7c880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521808 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017422:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748422.017435:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748422.017441:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c200/0x5b377f42a7a7cefb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c8 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017454:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:2.0:1788748422.017456:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748422.017459:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536f000/0x5b377f42a7a7c8e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521824 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017471:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748422.017474:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748422.017476:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43a00/0x5b377f42a7a7c554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521736 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017488:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec3e09400) 00010000:00010000:2.0:1788748422.017491:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748422.017495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5800/0x5b377f42a7a7c1f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521648 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017513:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748422.017516:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788748422.017521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5c00/0x5b377f42a7a7ced8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219c1 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017532:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cecfaef000) 00010000:00010000:2.0:1788748422.017534:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748422.017537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9800/0x5b377f42a7a7c267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521664 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017565:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748422.017567:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748422.017572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fc00/0x5b377f42a7a7cf10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219cf expref: 13 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017582:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cec3e09500) 00010000:00010000:2.0:1788748422.017584:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748422.017587:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536e400/0x5b377f42a7a7c776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265217c2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017602:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec9769200) 00010000:00010000:2.0:1788748422.017604:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748422.017608:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43800/0x5b377f42a7a7c213 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652164f expref: 11 pid: 8052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017623:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748422.017625:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748422.017628:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2e00/0x5b377f42a7a7cbe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265218fd expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017638:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cecfaef600) 00010000:00010000:2.0:1788748422.017640:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748422.017644:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2000/0x5b377f42a7a7ce06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521989 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017657:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cec6646300) 00010000:00010000:2.0:1788748422.017659:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748422.017669:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7c905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee622652182b expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748422.017684:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cefd78c800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788748422.017698:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748422.017700:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748422.017702:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748422.254170:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748423.210119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748423.210186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748423.210329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358218496 00000100:00100000:0.0:1788748423.210339:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358218496 00000100:00100000:0.0:1788748423.210407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:0.0:1788748423.210417:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2350:x1875638358218496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748423.210491:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62c24351-d204-4cbb-bccb-959b10d053e2+10:2350:x1875638358218496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748423.210498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:3.0:1788748423.210628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358218624 00000100:00100000:3.0:1788748423.210633:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358218624 00000100:00100000:3.0:1788748423.210691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1788748423.210699:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2350:x1875638358218624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748423.210730:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2350:x1875638358218624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748423.210736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00080000:0.0:1788748423.210947:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748423.277350:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748423.513200:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:1.0:1788748423.513210:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cee52f8000/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:3.0:1788748423.513315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee52f8000/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-OST0001 00000020:00000080:3.0:1788748423.513368:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee52fa800 for lustre-OST0001 00010000:00010000:2.0:1788748424.301532:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748424.429797:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377070080:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.429866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.429920:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748424.429926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377069696:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.429948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.429969:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377070208:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.429991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.430036:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377069824:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430058:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.430076:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377070336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430096:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.430114:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748424.430119:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377069952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.430170:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070080 00000100:00100000:2.0:1788748424.430177:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070080 00000100:00100000:2.0:1788748424.430239:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070336 00000100:00100000:2.0:1788748424.430243:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070336 00000100:00100000:2.0:1788748424.430263:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788748424.430272:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377070080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430322:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377070080:12345-0@lo:400:kworker.0 Request processed in 51us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430328:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788748424.430345:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788748424.430351:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377070336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430382:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377070336:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430389:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788748424.430406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069696 00000100:00100000:2.0:1788748424.430414:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069696 00000100:00100000:2.0:1788748424.430435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788748424.430441:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377069696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430470:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377069696:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788748424.430499:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070208 00000100:00100000:2.0:1788748424.430503:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070208 00000100:00100000:2.0:1788748424.430522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069824 00000100:00100000:2.0:1788748424.430524:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069824 00000100:00100000:2.0:1788748424.430534:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377069952 00000100:00100000:2.0:1788748424.430536:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377069952 00000100:00100000:2.0:1788748424.430547:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788748424.430554:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377070208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430583:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377070208:12345-0@lo:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788748424.430609:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788748424.430615:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430642:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377069824:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788748424.430657:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788748424.430662:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430683:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377069952:12345-0@lo:400:kworker.0 Request processed in 21us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.430688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1788748424.430707:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748424.430711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748424.430713:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748424.430738:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377069952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430747:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377069824:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430753:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377070336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430773:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377069696:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430781:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377070208:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.430812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377070080:0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.527767:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748424.527821:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748424.527868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748424.533226:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358218752 00000100:00100000:1.0:1788748424.533242:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358218752 00000100:00100000:1.0:1788748424.533326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219008 00000100:00100000:1.0:1788748424.533331:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219008 00000100:00100000:1.0:1788748424.533345:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358218880 00000100:00100000:1.0:1788748424.533348:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358218880 00000100:00100000:1.0:1788748424.533369:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788748424.533378:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+12:2347:x1875638358218752:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748424.533410:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748424.533432:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4400/0x5b377f42a7a7bfff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521584 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748424.533450:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748424.533515:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+11:2347:x1875638358218752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 137us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.533522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788748424.533542:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748424.533549:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+10:2347:x1875638358219008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748424.533556:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748424.533566:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7c1c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521633 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748424.533577:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748424.533606:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+9:2347:x1875638358219008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 58us (5785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.533613:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748424.533626:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748424.533632:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+8:2347:x1875638358218880:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748424.533640:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748424.533648:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7c006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265215ae expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748424.533656:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748424.533674:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62c24351-d204-4cbb-bccb-959b10d053e2+7:2347:x1875638358218880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (5806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.533686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788748424.536266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748424.536340:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219264 00000100:00100000:1.0:1788748424.536349:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219264 00000100:00100000:1.0:1788748424.536400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:1.0:1788748424.536409:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+6:2346:x1875638358219264:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:1.0:1788748424.536444:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7c014 00000020:00010000:1.0:1788748424.536452:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cef7469800: total 0 00000100:00080000:1.0:1788748424.536457:0:5845:0:(import.c:65:import_set_state_nolock()) ffff99cef746a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748424.536478:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788748424.536503:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cef7469800: total 0 00010000:00010000:3.0:1788748424.536510:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748424.536561:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cef7469800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788748424.536598:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec9769f00) 00010000:00010000:3.0:1788748424.536603:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748424.536612:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ee00/0x5b377f42a7a7cf33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219dd expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748424.536643:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cef7469800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788748424.536655:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748424.536656:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748424.536658:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748424.536690:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dc7f066-3fff-4454-91e9-5eb71e45ae83+3:2346:x1875638358219264:12345-192.168.203.4@tcp:39:umount.0 Request processed in 281us (431us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788748424.536699:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:1.0:1788748424.562702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748424.562890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219520 00000100:00100000:3.0:1788748424.562900:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219520 00000100:00100000:3.0:1788748424.562965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:3.0:1788748424.562976:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+7:2346:x1875638358219520:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:3.0:1788748424.563074:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bf0a 00000020:00010000:3.0:1788748424.563081:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cefbb38000: total 0 00000100:00080000:3.0:1788748424.563086:0:5838:0:(import.c:65:import_set_state_nolock()) ffff99cefbb3d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788748424.563156:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62c24351-d204-4cbb-bccb-959b10d053e2+3:2346:x1875638358219520:12345-192.168.203.4@tcp:251:umount.0 Request processed in 181us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748424.563164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 299 00000020:00010000:0.0:1788748424.563569:0:6710:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cefbb38000: total 0 00010000:00010000:0.0:1788748424.563626:0:6710:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cefbb38000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788748424.563658:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42c00/0x5b377f42a7a7bfc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521576 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748424.563672:0:6710:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cefbb38000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788748424.563681:0:6710:0:(genops.c:885:class_export_put()) final put ffff99cefbb38000/62c24351-d204-4cbb-bccb-959b10d053e2 00010000:00010000:0.0:1788748424.563694:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748424.563697:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748424.563705:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748424.564526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefbb38000/62c24351-d204-4cbb-bccb-959b10d053e2 for MGS 00000020:00000080:3.0:1788748424.564571:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefbb3d000 for MGS 00000100:00100000:2.0:1788748424.942055:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748424.942078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377070464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748424.942178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748424.953478:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070464 00000100:00100000:1.0:1788748424.953494:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070464 00000100:00100000:1.0:1788748424.954540:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748424.954552:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377070464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748424.955468:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748424.955557:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377070464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1004us (13376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.955566:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748424.956457:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377070464:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788748425.016979:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:1.0:1788748425.016987:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cee516e000/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:0.0:1788748425.017082:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee516e000/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-OST0000 00000020:00000080:0.0:1788748425.017151:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee516f800 for lustre-OST0000 00000001:00080000:3.0:1788748425.021176:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:3.0:1788748425.021198:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000001:00080000:3.0:1788748425.021204:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788748425.021207:0:5866:0:(genops.c:885:class_export_put()) final put ffff99cef7469800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 00000001:00100000:3.0:1788748425.021226:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000001:00080000:3.0:1788748425.021233:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788748425.021239:0:5866:0:(genops.c:885:class_export_put()) final put ffff99cefd78c800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 00000020:00000080:1.0:1788748425.021394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef7469800/9dc7f066-3fff-4454-91e9-5eb71e45ae83 for lustre-MDT0000 00000020:00000080:1.0:1788748425.021464:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd78c800/7b6e58be-3dc9-4518-a85f-e723d86d70a3 for lustre-MDT0000 00000020:00000080:1.0:1788748425.021489:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cef746a800 for lustre-MDT0000 00000020:00000080:1.0:1788748425.021499:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd78f800 for lustre-MDT0000 00010000:00010000:0.0:1788748425.328654:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748425.454330:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377070592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748425.454398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748425.454554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070592 00000100:00100000:2.0:1788748425.454562:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070592 00000100:00100000:2.0:1788748425.454625:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748425.454636:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377070592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748425.454669:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748425.454717:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee52e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377070592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748425.454724:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748425.454765:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377070592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748426.358618:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788748426.377512:0:12914:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788748426.390531:0:12914:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788748426.390573:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.390587:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.390594:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.390601:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.390632:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748426.390638:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788748426.390660:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748426.390665:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788748426.390671:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788748426.390685:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748426.390694:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.390703:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057400 already unused, calling callback (ffffffffc1d1ec20) 00000100:00080000:2.0:1788748426.390706:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ef800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1788748426.390708:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.390729:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748426.390747:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748426.390754:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748426.390756:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788748426.390759:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788748426.390781:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.390787:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748426.390911:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.390920:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057400/0x5b377f42a7a7bf8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.390932:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748426.390934:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748426.390936:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748426.390943:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748426.390959:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377070848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748426.391039:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748426.393234:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377070720:0@lo:39:umount.0 00000100:00100000:3.0:1788748426.393298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748426.393468:0:8052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070720 00000100:00100000:2.0:1788748426.393477:0:8052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070720 00000100:00100000:2.0:1788748426.393525:0:8052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788748426.393534:0:8052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875638377070720:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788748426.393561:0:8052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bd19 00000100:00080000:2.0:1788748426.393570:0:8052:0:(import.c:65:import_set_state_nolock()) ffff99cefd3b9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788748426.393603:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748426.393645:0:8052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875638377070720:12345-0@lo:39:umount.0 Request processed in 110us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748426.393652:0:8052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:3.0:1788748426.393660:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788748426.393664:0:8052:0:(genops.c:885:class_export_put()) final put ffff99cefd3b8000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788748426.393675:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377070720:0@lo:39:umount.0 00000100:00080000:2.0:1788748426.393697:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748426.393701:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748426.393706:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748426.394096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3b8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788748426.394301:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd3b9000 for lustre-MDT0000 00000100:00100000:3.0:1788748426.394319:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070848 00000100:00100000:3.0:1788748426.394324:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070848 00000100:00100000:3.0:1788748426.394364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748426.394372:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3306:x1875638377070848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748426.394383:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748426.394400:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5400/0x5b377f42a7a7bf96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf8f expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.394413:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748426.394453:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3306:x1875638377070848:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.394460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748426.394498:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3306:1875638377070848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748426.401789:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401819:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401826:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401833:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401852:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748426.401858:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401882:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401889:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401895:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401910:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788748426.401917:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401924:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401931:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401937:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401950:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788748426.401955:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401962:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401980:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401986:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748426.401994:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788748426.401997:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788748426.402054:0:12914:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788748426.402058:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788748426.402062:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748426.402067:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788748426.402074:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cefd851000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748426.402079:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cefd3ce000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748426.402084:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99cee507cd40) has exports, disconnecting them 00000020:00080000:2.0:1788748426.402089:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cefd851000), last request at 1788748424 00000020:00000080:2.0:1788748426.402096:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be8c 00000100:00080000:2.0:1788748426.402114:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99cefd853000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748426.402163:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cefd851000): rc 0 00000020:00000080:2.0:1788748426.402183:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd851000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788748426.402195:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cefd3ce000), last request at 1788748424 00000020:00000080:2.0:1788748426.402198:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bdc1 00000100:00080000:2.0:1788748426.402204:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99cefd3cc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748426.402210:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cefd3ce000): rc 0 00000020:00000080:2.0:1788748426.402212:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd3ce000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788748426.402219:0:12914:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6f542e13ae0 00000100:00080000:2.0:1788748426.402239:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788748426.402247:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788748426.402259:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748426.403404:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788748426.403432:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e1a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788748426.403454:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788748426.403457:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788748426.403469:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748426.403526:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788748426.403534:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99ceecebc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788748426.403586:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99cee507cd40) has no exports 00010000:00010000:3.0:1788748426.403644:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788748426.403654:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403664:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748426.403669:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403678:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748426.403684:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748426.403690:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748426.403702:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788748426.403705:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788748426.403729:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403735:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748426.403755:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403762:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7bf9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bfa4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403773:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748426.403776:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403782:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147cc00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748426.403784:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403801:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748426.403808:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748426.403813:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748426.403815:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788748426.403817:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788748426.403827:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403842:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748426.403851:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403857:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147cc00/0x5b377f42a7a7bec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7becb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403870:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748426.403873:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403879:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748426.403881:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403889:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748426.403896:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748426.403902:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788748426.403904:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788748426.403906:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788748426.403919:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.403926:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748426.404011:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404044:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceecec3e00/0x5b377f42a7a7c1b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7c1bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404053:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748426.404056:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404062:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748426.404064:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404071:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748426.404077:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748426.404081:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748426.404083:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788748426.404085:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1788748426.404313:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748426.404332:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377071488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748426.404407:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748426.404591:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404598:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748426.404606:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404612:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec0031400/0x5b377f42a7a7bc78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.404636:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748426.404638:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748426.404640:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748426.404652:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748426.404774:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748426.404833:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748426.404841:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748426.404864:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788748426.404948:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd851000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788748426.404997:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3ce000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788748426.405048:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd853000 for lustre-MDT0000 00000020:00000080:3.0:1788748426.405054:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd3cc800 for lustre-MDT0000 00010000:00010000:3.0:1788748426.405062:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748426.405087:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071488 00000100:00100000:3.0:1788748426.405106:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071488 00000100:00100000:3.0:1788748426.405147:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071360 00000100:00100000:3.0:1788748426.405150:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071360 00000100:00100000:3.0:1788748426.405163:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071232 00000100:00100000:3.0:1788748426.405165:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071232 00000100:00100000:3.0:1788748426.405180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748426.405188:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+20:3307:x1875638377071488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748426.405200:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748426.405214:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43e00/0x5b377f42a7a7c1bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7c1b8 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.405227:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748426.405260:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+19:3307:x1875638377071488:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.405273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748426.405313:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788748426.405320:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+18:3309:x1875638377071360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748426.405327:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748426.405336:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02056c00/0x5b377f42a7a7becb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bec4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.405347:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748426.405389:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+17:3309:x1875638377071360:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.405395:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788748426.405407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748426.405413:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+16:3309:x1875638377071232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748426.405431:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748426.405439:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7bfa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf9d expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.405448:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748426.405469:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3309:x1875638377071232:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.405474:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748426.405506:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748426.405514:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748426.405540:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377070976:0@lo:9:umount.0 00000100:00100000:3.0:1788748426.405567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748426.405597:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377071104:0@lo:9:umount.0 00000100:00100000:3.0:1788748426.405618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748426.405648:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377070976 00000100:00100000:3.0:1788748426.405652:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377070976 00000100:00100000:3.0:1788748426.405689:0:8053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071104 00000100:00100000:3.0:1788748426.405693:0:8053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071104 00000100:00100000:3.0:1788748426.405719:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788748426.405728:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875638377070976:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788748426.405750:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be1c 00000100:00080000:3.0:1788748426.405759:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cefd76d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748426.405802:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788748426.406121:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1875638377070976:12345-0@lo:9:umount.0 Request processed in 394us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.406128:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788748426.406142:0:8053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788748426.406148:0:8053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875638377071104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788748426.406160:0:8053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bef5 00000100:00080000:3.0:1788748426.406166:0:8053:0:(import.c:65:import_set_state_nolock()) ffff99cefd852000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748426.406187:0:8053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788748426.406372:0:8053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1875638377071104:12345-0@lo:9:umount.0 Request processed in 225us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.406379:0:8053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788748426.406401:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748426.406404:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788748426.406413:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748426.406434:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e1a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788748426.406447:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788748426.406449:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748426.406453:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377070976:0@lo:9:umount.0 00000100:00080000:3.0:1788748426.406474:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788748426.406484:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788748426.406486:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748426.406489:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377071104:0@lo:9:umount.0 00010000:00010000:1.0:1788748426.406672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748426.406764:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748426.407617:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377071488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748426.407641:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377071616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748426.407681:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748426.407782:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071616 00000100:00100000:3.0:1788748426.407788:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071616 00000100:00100000:3.0:1788748426.407848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748426.407858:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+15:3307:x1875638377071616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748426.407870:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748426.407886:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42800/0x5b377f42a7a7bc7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bc78 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748426.407902:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748426.408031:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30aac72-4ae1-4e90-ba43-18115a48a5f4+14:3307:x1875638377071616:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748426.408039:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748426.408079:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3307:1875638377071616:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788748426.419665:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99cee507cd40) has no exports 00000020:00000080:3.0:1788748426.485912:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bcd3 00000020:00000080:3.0:1788748426.485927:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd3be800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788748426.485943:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788748426.486085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3be800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788748426.486109:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748426.486118:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788748426.486122:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ceecf93380) has no exports 00000020:00000080:2.0:1788748426.489358:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bccc 00000020:00000080:2.0:1788748426.489373:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd3a6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788748426.489535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3a6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788748426.489761:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748426.489772:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788748426.489776:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd3a7800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788748426.489779:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3a7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788748426.489800:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788748426.489933:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cee034dea0 - data ffff99cedb3d35e8/ffff99cefd7e0400 00000020:01000000:2.0:1788748426.492627:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ceed787720 - data ffff99cedb088870/ffff99cefd748800 00000001:00000004:2.0:1788748426.510703:0:12914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788748426.635176:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748426.635183:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788748426.635200:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748426.635203:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788748426.636800:0:6920:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788748426.636807:0:6920:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788748426.636818:0:6920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788748426.639251:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748426.639258:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788748426.639290:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748426.639294:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788748426.640663:0:8049:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788748426.640669:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788748426.640682:0:8049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788748426.710234:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bc9b 00000020:00000080:1.0:1788748426.710247:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cf01944800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788748426.710930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cf01944800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788748426.711742:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bcb0 00000020:00000080:1.0:1788748426.711753:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cef2bd9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788748426.711809:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788748426.711815:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.711828:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748426.711832:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99ceece70000) has no exports 00000004:01000000:1.0:1788748426.712004:0:12914:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788748426.712034:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7beee 00000020:00000080:1.0:1788748426.712039:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd854000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748426.712143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2bd9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788748426.712345:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788748426.712351:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.712359:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788748426.712362:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff99cefd4a0000) has no exports 00000020:00000080:1.0:1788748426.712369:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bee7 00000020:00000080:1.0:1788748426.712373:0:12914:0:(genops.c:885:class_export_put()) final put ffff99ceecebb800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788748426.712400:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd854000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788748426.712410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceecebb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788748426.712815:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788748426.712820:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788748426.712824:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788748426.712841:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788748426.712844:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748426.712896:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.712904:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748426.712913:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be07 00000020:00000080:1.0:1788748426.712918:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cdc6968000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788748426.712926:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788748426.712929:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.712934:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788748426.712936:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99cefb82b380) has no exports 00000020:00000080:1.0:1788748426.712941:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be00 00000020:00000080:1.0:1788748426.712944:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cee52ff000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788748426.712945:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ceecebc000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788748426.712962:0:8:0:(genops.c:885:class_export_put()) final put ffff99cefd855000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748426.712964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd855000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788748426.712969:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748426.713943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc6968000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788748426.713952:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee52ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788748426.717534:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788748426.717542:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788748426.717546:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788748426.717553:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788748426.717556:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748426.717605:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.717617:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748426.717643:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cdc4e1a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788748426.717652:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.717657:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748426.717662:0:12914:0:(genops.c:885:class_export_put()) final put ffff99ced02b2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748426.717666:0:8:0:(genops.c:885:class_export_put()) final put ffff99cefd3ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788748426.717667:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99ced02b2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788748426.717671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788748426.717678:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788748426.717680:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748426.717928:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bcb7 00000020:00000080:1.0:1788748426.717936:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cef2bdb800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788748426.717954:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788748426.717959:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.717964:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748426.717968:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99cee50799c0) has no exports 00000020:00000080:0.0:1788748426.717985:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2bdb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788748426.718095:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.718100:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788748426.718110:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cf01947800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788748426.718113:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99cf01947800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788748426.718119:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788748426.718413:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bcbe 00000020:00000080:1.0:1788748426.718418:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cef2bdc800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788748426.718439:0:12914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec8720800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788748426.718443:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec8720800 3 00000020:01000004:1.0:1788748426.718447:0:12914:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cec8720800 from lustre-MDT0000 00000020:00000080:1.0:1788748426.718475:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.718481:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788748426.718484:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cf01943800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788748426.718487:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99cf01943800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788748426.718500:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788748426.718538:0:12914:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788748426.718542:0:12914:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788748426.718545:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788748426.718548:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.718550:0:12914:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788748426.718556:0:12914:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99cec653b000 e30aac72-4ae1-4e90-ba43-18115a48a5f4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788748426.718561:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99ceece73380) has exports, disconnecting them 00000020:00080000:1.0:1788748426.718565:0:12914:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99cec653b000), last request at 1788748219 00000020:00000080:1.0:1788748426.718578:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bc5c 00000020:00010000:1.0:1788748426.718582:0:12914:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cec653b000: total 1 00000020:00000080:3.0:1788748426.718587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2bdc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1788748426.718587:0:12914:0:(import.c:65:import_set_state_nolock()) ffff99ced02b1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788748426.718611:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cec653b000): rc 0 00000020:00080000:1.0:1788748426.718615:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99ceece73380) has no exports 00000020:00010000:0.0:1788748426.718640:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cec653b000: total 0 00010000:00010000:0.0:1788748426.718667:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cec653b000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788748426.718700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02057200/0x5b377f42a7a7bf5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf57 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718717:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7bf6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf65 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718728:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02056600/0x5b377f42a7a7bf7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf73 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718739:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43200/0x5b377f42a7a7bf88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bf81 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718750:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02056a00/0x5b377f42a7a7c1a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7c19c expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718761:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147c600/0x5b377f42a7a7bd74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bd6d expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718774:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7bfb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7bfab expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cf02057a00/0x5b377f42a7a7c1b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7c1aa expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748426.718805:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cec653b000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788748426.718825:0:5832:0:(genops.c:885:class_export_put()) final put ffff99cec653b000/e30aac72-4ae1-4e90-ba43-18115a48a5f4 00010000:00010000:0.0:1788748426.718849:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748426.718851:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748426.718853:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748426.718916:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ceed76fc00:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1788748426.719045:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ceed76ec00:5838] 1 exiting: rc = 0 00000020:00000080:1.0:1788748426.719165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec653b000/e30aac72-4ae1-4e90-ba43-18115a48a5f4 for MGS 00000020:00000080:1.0:1788748426.719233:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ced02b1000 for MGS 00000100:00100000:2.0:1788748426.719525:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ceece14a00:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1788748426.719881:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719898:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719904:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719911:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719923:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719929:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719934:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719946:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719953:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719959:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719965:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719977:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719985:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.719991:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720004:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720042:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720056:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720065:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720073:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720086:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720091:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720098:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720110:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720117:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720123:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720134:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720141:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720147:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720152:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720165:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720180:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720194:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720199:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720205:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720209:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720229:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720236:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720241:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720253:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720260:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720265:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720277:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720283:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720288:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720293:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720307:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720312:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720317:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720329:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720335:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720339:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720344:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720349:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720362:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720369:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720374:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720386:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720392:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720398:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720410:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720416:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720421:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720427:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.720440:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788748426.721211:0:12914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788748426.721304:0:12914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788748426.724207:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a67540 - data ffff99cdc4867000/ffff99ceed56cc00 00000020:01000000:0.0:1788748426.724355:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ceed76a9c0 - data ffff99ceef71d438/ffff99ceecc01800 00000020:00000080:0.0:1788748426.724979:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bc40 00000020:00000080:0.0:1788748426.724989:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cec8724800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788748426.725042:0:12914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec8720800 from MGS, refs=2 00000020:01000004:0.0:1788748426.725046:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec8720800 2 00000020:01000004:0.0:1788748426.725049:0:12914:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cec8720800 from MGS 00000020:00000080:0.0:1788748426.725071:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748426.725078:0:12914:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788748426.725080:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cec8727800/MGS 00000020:00000080:0.0:1788748426.725083:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec8727800/MGS for MGS 00000020:01000000:0.0:1788748426.725090:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788748426.725142:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788748426.725146:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748426.725151:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788748426.725157:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99cefd3e8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788748426.725162:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff99cefd4a19c0) has exports, disconnecting them 00000020:00080000:0.0:1788748426.725166:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99cefd3e8000), last request at 1788748220 00000020:00000080:0.0:1788748426.725170:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bd0b 00000020:00080000:0.0:1788748426.725179:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cefd3e8000): rc 0 00000020:00000080:0.0:1788748426.725184:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cefd3e8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788748426.725310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec8724800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788748426.725316:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3e8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788748426.727105:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788748426.727121:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748426.727126:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788748426.727131:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748426.727296:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748426.727304:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788748426.727309:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec8720800 1 00000020:00000080:1.0:1788748426.727314:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bc32 00000020:00000080:1.0:1788748426.727321:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cec8725800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788748426.727326:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788748426.727330:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748426.727332:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748426.727335:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99ceecf919c0) has no exports 00000020:00000080:3.0:1788748426.727459:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd3ef800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788748426.727466:0:8:0:(genops.c:885:class_export_put()) final put ffff99cf01986000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788748426.727469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cf01986000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788748426.727477:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788748426.727526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec8725800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788748426.745109:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748426.745129:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788748426.745134:0:12914:0:(genops.c:885:class_export_put()) final put ffff99cec31aa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788748426.745139:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec31aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788748426.745151:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788748426.745323:0:12914:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cec8720000 00000020:01000000:3.0:1788748426.745351:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788748426.745356:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748426.745361:0:12914:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788748426.745365:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99cee5078000) has no exports 00000100:00100000:3.0:1788748426.745448:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99cec593d200:5846] 2 exiting: rc = 0 00000100:00100000:2.0:1788748426.746552:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99ceece8ce00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788748426.746711:0:8052:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99cf019aac00:8052] 3 exiting: rc = 0 00000100:00100000:1.0:1788748426.749851:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99ceece8d000:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1788748426.750247:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750256:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750261:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750267:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750273:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750279:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750284:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750290:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750297:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750303:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750310:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750319:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750327:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750352:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750359:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750366:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750373:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750379:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750386:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750393:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750399:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750405:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750412:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750419:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750426:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750433:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750441:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750448:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750455:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750462:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750469:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750477:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750484:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750492:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750500:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750507:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750514:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750519:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750526:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750533:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750540:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750546:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750553:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750671:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750679:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750687:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750694:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750701:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750717:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750725:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750734:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750741:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750748:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750754:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750760:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750767:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750775:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750781:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750797:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750805:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750812:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750819:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750827:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.750835:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748426.756443:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99cec593c800:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1788748426.756671:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99cec593c600:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1788748426.756955:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756963:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756967:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756974:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756980:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756985:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756991:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.756996:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757001:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757007:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757039:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757047:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757053:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757058:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757063:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757068:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757073:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757079:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757084:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757100:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757105:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757111:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757115:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757120:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757125:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757130:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757135:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757140:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757144:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757149:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757155:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757160:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757166:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757172:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757178:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757184:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757190:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757196:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757202:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757208:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757213:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757349:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757359:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757364:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757370:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757375:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757380:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757386:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757392:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757396:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757402:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757408:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757414:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757421:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757435:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757440:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757445:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757450:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757456:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757463:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757470:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757474:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757480:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.757485:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748426.758282:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99cec593dc00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1788748426.758469:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99cec45ec800:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1788748426.758522:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758530:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758536:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758541:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758547:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758552:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758632:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758641:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758647:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758653:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758670:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758677:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758683:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758689:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758698:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758705:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758711:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758717:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758722:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758730:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758736:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758742:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758765:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758772:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758798:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758806:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758813:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758819:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758824:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758830:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758836:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758847:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758855:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758875:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758882:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758887:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758893:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758901:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758907:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758914:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758920:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758926:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758932:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758938:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758944:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758963:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758971:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758977:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758983:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758989:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.758996:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759002:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759007:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759041:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759048:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759054:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759061:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759081:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759095:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759102:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759109:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759134:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.759151:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748426.770861:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99ced02ac200:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1788748426.771095:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ced02acc00:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1788748426.771347:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771355:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771361:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771366:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771372:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771378:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771384:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771391:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771397:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771403:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771409:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771416:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771422:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771428:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771433:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771439:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771445:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771451:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771457:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771463:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771469:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771474:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771480:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771487:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771492:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771497:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771502:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771507:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771512:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771517:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771536:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771542:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771548:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771554:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771638:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771646:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771652:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771657:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771662:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771668:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771674:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771680:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771686:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771693:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771699:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771704:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771710:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771716:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771721:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771727:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771733:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771739:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771745:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771750:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771756:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771761:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771768:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771774:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771780:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771787:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771803:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771808:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771813:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.771819:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748426.772350:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ced02ad800:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788748426.772421:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99ced0298c00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1788748426.772546:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772574:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772581:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772588:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772594:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772603:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772607:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772613:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772618:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772623:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772630:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772637:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772644:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772650:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772656:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772662:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772668:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772674:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772680:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772687:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772694:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772700:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772706:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772712:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772718:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772724:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772730:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772737:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772743:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772749:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772754:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772759:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772764:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772769:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772775:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772781:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772805:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772810:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772816:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772821:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772828:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772835:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772848:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772854:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772859:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772864:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772868:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772872:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772877:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772881:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772886:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772903:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772909:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772913:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772919:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772925:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772930:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772934:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772939:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772944:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772948:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772953:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.772959:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748426.773334:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99ced02ac400:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1788748426.779187:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99ced02aca00:5856] 1 exiting: rc = 0 00000100:00100000:3.0:1788748426.779419:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779427:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779432:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779437:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779443:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779448:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779453:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779470:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779474:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779481:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779486:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779490:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779494:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779500:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779506:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779511:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779516:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779522:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779528:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779534:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779541:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779547:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779554:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779643:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779651:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779657:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779664:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779670:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779675:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779681:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779687:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779692:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779698:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779704:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779712:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779718:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779724:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779730:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779735:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779741:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779746:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779751:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779762:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779767:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779774:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779781:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779797:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779805:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779811:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779817:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779823:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779829:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779836:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779842:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779849:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779854:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779859:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779863:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779868:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779873:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779877:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779882:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779887:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.779893:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748426.780695:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99ced0299400:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1788748426.780965:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99ced029da00:5857] 0 exiting: rc = 1 00000100:00100000:1.0:1788748426.781426:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99ced0298400:5859] 2 exiting: rc = 0 00000100:00100000:3.0:1788748426.781551:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781626:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781635:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781640:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781646:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781652:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781658:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781663:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781668:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781673:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781679:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781684:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781690:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781708:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781715:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781722:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781729:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781735:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781741:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781748:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781754:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781761:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781780:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781798:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781806:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781816:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781823:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781830:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781835:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781847:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781853:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781859:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781864:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781870:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781876:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781882:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781887:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781893:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781899:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781906:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781913:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781920:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781925:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781931:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781937:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781957:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781965:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781977:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781983:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781990:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.781997:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782003:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782074:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782083:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782088:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782093:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782098:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782104:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782109:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782114:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782120:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782126:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748426.782142:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788748426.787279:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748426.787293:0:12914:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788748426.787298:0:12914:0:(genops.c:885:class_export_put()) final put ffff99ced141b800/MDS_uuid 00000020:00000080:3.0:1788748426.787303:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff99ced141b800/MDS_uuid for MDS 00000020:01000000:3.0:1788748426.787309:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788748426.787424:0:12914:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788748427.373667:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748428.398263:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748428.564103:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788748428.564112:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cefd857800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748428.564339:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd857800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788748428.564568:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd852000 for lustre-OST0001 00000020:01000004:2.0:1788748429.417642:0:13066:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:0.0:1788748429.424220:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788748429.437563:0:13066:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788748429.437612:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748429.437646:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748429.437653:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748429.437659:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748429.437706:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788748429.437712:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788748429.437733:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788748429.437745:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788748429.437752:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788748429.437785:0:13066:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e19000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788748429.437888:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377071744:0@lo:39:umount.0 00000400:00000100:3.0:1788748429.437946:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377071744 offset 0 length 224: 4 00010000:00010000:2.0:1788748429.438489:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748429.438498:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748429.438507:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748429.438510:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748429.438520:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748429.438527:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748429.438532:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748429.438535:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788748429.438537:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788748429.438567:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748429.438573:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748429.438600:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748429.438607:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7bf73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7bf7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748429.438620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748429.438621:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748429.438623:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748429.438832:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748429.438847:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748429.438896:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748429.439233:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377071872 00000100:00100000:2.0:1788748429.439241:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377071872 00000100:00100000:2.0:1788748429.439370:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748429.439380:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875638377071872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788748429.439386:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748429 with bad export cookie 6572862105427885148 00000100:00100000:3.0:1788748429.453532:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875638377071872:12345-0@lo:103:ldlm_bl.0 Request processed in 14146us (14628us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788748429.453546:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788748429.453701:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788748429.453707:0:3309:0:(import.c:65:import_set_state_nolock()) ffff99cec6633800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788748429.453710:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788748429.469728:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788748429.469733:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788748429.469751:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cefb632300 x1875638377071872/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788748429.469789:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788748429.469792:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788748429.469793:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788748429.469797:0:3309:0:(import.c:65:import_set_state_nolock()) ffff99cec6633800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748429.469803:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 136 00000100:00080000:1.0:1788748429.469817:0:3309:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff99cec6633800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748429.469847:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc5c93100 x1875638377072000/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748429.469883:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3309:1875638377071872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748429.470903:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638377072000:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788748429.470969:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638377072000 offset 0 length 520: 4 00000100:00100000:1.0:1788748429.549477:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377072128:0@lo:400:kworker.0 00000400:00000100:1.0:1788748429.549531:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377072128 offset 0 length 224: 4 00000001:00100000:0.0:1788748430.202207:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748430.202217:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cefd76b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788748430.202472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd76b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788748430.202535:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd76d800 for lustre-OST0000 00010000:00010000:2.0:1788748430.445601:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748431.469221:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748432.493577:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748433.517433:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748434.541178:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748434.669451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748434.669462:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788748434.669637:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377072256:0@lo:400:kworker.0 00000400:00000100:1.0:1788748434.669691:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377072256 offset 0 length 224: 4 00010000:00010000:1.0:1788748435.574322:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748436.589472:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748437.613219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748438.639926:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748439.662040:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748439.789166:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748429/real 1788748429] req@ffff99cdc5c93100 x1875638377072000/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748439.789216:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdc5c93100 x1875638377072000/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748439.789228:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748429/real 1788748429] req@ffff99cdc60b8e00 x1875638377071744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748439.789238:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdc60b8e00 x1875638377071744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748439.789254:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec6633800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748439.789273:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788748439.789277:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638377072000:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788748439.789283:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e19000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788748439.789303:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377071744:0@lo:39:umount.0 00000100:00080000:0.0:1788748439.789422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788748439.789428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788748439.789430:0:8:0:(import.c:65:import_set_state_nolock()) ffff99cec6633800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748439.789435:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 346 00000100:00080000:0.0:1788748439.789440:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788748439.789450:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff99cec6633800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748439.789482:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc60bbb80 x1875638377072384/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748439.789552:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748439.789563:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377072512:0@lo:400:kworker.0 00000400:00000100:0.0:1788748439.789606:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377072512 offset 0 length 224: 4 00000100:00100000:2.0:1788748439.789730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638377072384:0@lo:250:kworker.0 00000400:00000100:2.0:1788748439.789754:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638377072384 offset 0 length 520: 4 00000100:00080000:1.0:1788748439.789932:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748439.789937:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788748439.789941:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788748439.790837:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790852:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790860:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790879:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790904:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748439.790911:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790917:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790924:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790930:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748439.790951:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788748439.790955:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788748439.790979:0:13066:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788748439.790983:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788748439.790988:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748439.790993:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788748439.790997:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99cdc4e24d40) has no exports 00000020:00080000:1.0:1788748439.791049:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99cdc4e24d40) has no exports 00000020:01000000:1.0:1788748439.792883:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a67c00 - data ffff99cef5528948/ffff99ceed56fc00 00000020:01000000:1.0:1788748439.793004:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cdc6642d80 - data ffff99cedb03b1b0/ffff99cdc5074c00 00010000:00010000:2.0:1788748439.794445:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748439.794457:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794469:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748439.794488:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794498:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748439.794506:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748439.794512:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748439.794514:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788748439.794517:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788748439.794533:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:2.0:1788748439.794537:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794544:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057600/0x5b377f42a7a7bf81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794558:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748439.794562:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794567:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748439.794569:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794575:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748439.794581:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748439.794596:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788748439.794599:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788748439.794601:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788748439.794608:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:2.0:1788748439.794611:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794617:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7c1aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7c1b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748439.794626:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748439.794628:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748439.794630:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748439.795049:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788748439.811499:0:13066:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788748439.870965:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bd90 00000020:00000080:0.0:1788748439.870976:0:13066:0:(genops.c:885:class_export_put()) final put ffff99cdc4e18000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788748439.871005:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ceecff9800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788748439.871009:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecff9800 2 00000020:01000004:0.0:1788748439.871012:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ceecff9800 from lustre-OST0000 00000020:00000080:0.0:1788748439.871065:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748439.871074:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788748439.871077:0:13066:0:(genops.c:885:class_export_put()) final put ffff99cdc4e1c000/lustre-OST0000_UUID 00000020:00000080:0.0:1788748439.871080:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e1c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788748439.871091:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788748439.871134:0:13066:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788748439.871139:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788748439.871143:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748439.871147:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788748439.871153:0:13066:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99cefd3ec000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788748439.871159:0:13066:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff99ceecf94d40) has exports, disconnecting them 00000020:00080000:0.0:1788748439.871163:0:13066:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99cefd3ec000), last request at 1788748236 00000020:00000080:0.0:1788748439.871167:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bdba 00000020:00000080:1.0:1788748439.871274:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e18000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1788748439.871622:0:13066:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cefd3ec000): rc 0 00000020:00000080:0.0:1788748439.871628:0:13066:0:(genops.c:885:class_export_put()) final put ffff99cefd3ec000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788748439.874580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3ec000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788748439.875351:0:13066:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788748439.875357:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748439.875361:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788748439.875367:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748439.875538:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748439.875546:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788748439.875552:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecff9800 1 00000020:00000080:1.0:1788748439.875558:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bd4a 00000020:00000080:1.0:1788748439.875566:0:13066:0:(genops.c:885:class_export_put()) final put ffff99cee52fd800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788748439.875571:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788748439.875577:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748439.875581:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748439.875584:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99cefd4a3380) has no exports 00000020:00000080:3.0:1788748439.875836:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cdc4e19000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788748439.875844:0:8:0:(genops.c:885:class_export_put()) final put ffff99cdc4e1a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788748439.875846:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e1a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788748439.875855:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788748439.875905:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee52fd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788748439.898058:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748439.898073:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788748439.898079:0:13066:0:(genops.c:885:class_export_put()) final put ffff99ceecffd800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788748439.898083:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceecffd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788748439.898094:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788748439.898248:0:13066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ceecff8800 00000020:02000400:1.0:1788748439.898292:0:13066:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788748440.685441:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748441.709261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788748442.624436:0:13220:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788748442.643962:0:13220:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788748442.644110:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.644139:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.644147:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.644155:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.644174:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788748442.644178:0:13220:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788748442.644201:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788748442.644213:0:13220:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef730ca80 x1875638377072128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748445 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748442.644234:0:13220:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef730ea00 x1875638377072256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748442.644250:0:13220:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cdc60ba300 x1875638377072512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748442.644258:0:13220:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788748442.644291:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377072512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748442.644302:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377072256:0@lo:400:kworker.0 00000100:00080000:0.0:1788748442.644337:0:13220:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788748442.644361:0:13220:0:(import.c:65:import_set_state_nolock()) ffff99ceecebf000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788748442.644470:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377072128:0@lo:400:kworker.0 00000100:00100000:2.0:1788748442.644503:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377072640:0@lo:39:umount.0 00000400:00000100:2.0:1788748442.644553:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377072640 offset 0 length 224: 4 00010000:00010000:3.0:1788748442.645274:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748442.645286:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748442.645296:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748442.645300:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748442.645310:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748442.645317:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748442.645323:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748442.645338:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788748442.645341:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788748442.645356:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:3.0:1788748442.645360:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748442.645367:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7bf57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748442.645379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748442.645380:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748442.645382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748442.733996:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748443.757322:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748444.781464:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748444.911303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748444.911313:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788748445.805416:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748446.829871:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748447.853671:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748448.878369:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748449.903537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748450.029230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788748450.029241:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788748450.925393:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748451.949389:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748452.845181:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748442/real 1788748442] req@ffff99cdc60ba300 x1875638377072640/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748452 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748452.845217:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdc60ba300 x1875638377072640/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748452 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748452.845236:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788748452.845258:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377072640:0@lo:39:umount.0 00000100:00080000:0.0:1788748452.845512:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788748452.845517:0:13220:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788748452.845522:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788748452.846449:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846464:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846472:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846477:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846504:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748452.846511:0:13220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846518:0:13220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846524:0:13220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846529:0:13220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.846544:0:13220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788748452.846548:0:13220:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788748452.846579:0:13220:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788748452.846583:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788748452.846587:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748452.846592:0:13220:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788748452.846597:0:13220:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99cdc4e219c0) has no exports 00000020:00080000:0.0:1788748452.846637:0:13220:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99cdc4e219c0) has no exports 00010000:00010000:3.0:1788748452.848306:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748452.848320:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848331:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c000 already unused, calling callback (ffffffffc1d1ec20) 00000020:01000000:0.0:1788748452.848333:0:13220:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a67000 - data ffff99cedb0880d8/ffff99ceed6f5000 10000000:00010000:3.0:1788748452.848335:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848349:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748452.848356:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748452.848374:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748452.848378:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788748452.848381:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788748452.848398:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:3.0:1788748452.848402:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848409:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147c000/0x5b377f42a7a7bf65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bf6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848423:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748452.848427:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848432:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748452.848436:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848443:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748452.848450:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748452.848456:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788748452.848458:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788748452.848461:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788748452.848466:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:3.0:1788748452.848469:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848482:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceecec2400/0x5b377f42a7a7c19c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7c1a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748452.848503:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748452.848505:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748452.848507:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788748452.848524:0:13220:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cee034d600 - data ffff99cdc483c000/ffff99cefd738c00 00010000:00010000:2.0:1788748452.848821:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788748452.868542:0:13220:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788748452.910585:0:13220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be5b 00000020:00000080:0.0:1788748452.910594:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cefb0ae000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788748452.910625:0:13220:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ceecebd000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788748452.910629:0:13220:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecebd000 2 00000020:01000004:0.0:1788748452.910632:0:13220:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ceecebd000 from lustre-OST0001 00000020:00000080:0.0:1788748452.910661:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748452.910671:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788748452.910675:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cefb0ab000/lustre-OST0001_UUID 00000020:00000080:0.0:1788748452.910677:0:13220:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefb0ab000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788748452.910986:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788748452.911173:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefb0ae000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788748452.911785:0:13220:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e30aac72-4ae1-4e90-ba43-18115a48a5f4->MGS 00010000:00010000:0.0:1788748452.911802:0:13220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748452.911815:0:13220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748452.911821:0:13220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788748452.911824:0:13220:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788748452.911828:0:13220:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788748452.911840:0:13220:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:0.0:1788748452.911844:0:13220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cf02057000/0x5b377f42a7a7bd6d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bd74 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748452.911871:0:13220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748452.911878:0:13220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748452.911883:0:13220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788748452.911885:0:13220:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788748452.911887:0:13220:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788748452.911973:0:13220:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cec6633800 00010000:00010000:0.0:1788748452.911977:0:13220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b42a00/0x5b377f42a7a7bfab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7bfb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788748452.911995:0:13220:0:(import.c:65:import_set_state_nolock()) ffff99cec6633800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788748452.911999:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788748452.912001:0:13220:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788748452.912003:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788748452.912231:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788748452.912242:0:13220:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cdc60bbb80 x1875638377072384/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788748454 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788748452.912304:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788748452.912307:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788748452.917069:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e30aac72-4ae1-4e90-ba43-18115a48a5f4:3305:1875638377072384:0@lo:250:kworker.0 10000000:01000000:0.0:1788748452.917400:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788748452.917413:0:13220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7bc4e 00000020:00000080:0.0:1788748452.917422:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cec6636800/e30aac72-4ae1-4e90-ba43-18115a48a5f4 00000020:01000000:0.0:1788748452.917440:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.104@tcp (flags='') 00000020:00000080:0.0:1788748452.917449:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748452.917456:0:13220:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788748452.917460:0:13220:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99cee507b380) has no exports 10000000:01000000:1.0:1788748452.917521:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788748452.917622:0:13220:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.104@tcp: client import never connected 00000100:00080000:0.0:1788748452.917639:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788748452.917642:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788748452.917645:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788748452.917646:0:13220:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788748452.917702:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748452.917709:0:13220:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.104@tcp (uuid e30aac72-4ae1-4e90-ba43-18115a48a5f4) 00000020:01000000:0.0:1788748452.917715:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788748452.917718:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748452.917722:0:13220:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788748452.917727:0:13220:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99cefb0ae800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788748452.917731:0:13220:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff99ceece719c0) has exports, disconnecting them 00000020:00080000:0.0:1788748452.917735:0:13220:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99cefb0ae800), last request at 1788748253 00000020:00000080:0.0:1788748452.917739:0:13220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be85 00000020:00080000:0.0:1788748452.917751:0:13220:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cefb0ae800): rc 0 00000020:00000080:0.0:1788748452.917755:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cefb0ae800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788748452.918804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6636800/e30aac72-4ae1-4e90-ba43-18115a48a5f4 for MGC192.168.203.104@tcp 00000020:00000080:2.0:1788748452.918819:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cec6633800 for MGC192.168.203.104@tcp 00000020:00000080:2.0:1788748452.918824:0:36:0:(genops.c:885:class_export_put()) final put ffff99cec6634000/e30aac72-4ae1-4e90-ba43-18115a48a5f4 00000020:00000080:2.0:1788748452.918827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6634000/e30aac72-4ae1-4e90-ba43-18115a48a5f4 for MGC192.168.203.104@tcp 00000020:01000000:2.0:1788748452.918832:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.104@tcp (e30aac72-4ae1-4e90-ba43-18115a48a5f4) 00000020:00000080:2.0:1788748452.919204:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefb0ae800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788748452.919279:0:13220:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788748452.919284:0:13220:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748452.919288:0:13220:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788748452.919293:0:13220:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788748452.919472:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ceecebf000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788748452.923143:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788748452.923661:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788748452.924115:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788748452.924417:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99cec8ba2000:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788748452.924517:0:7637:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff99ceecce7800:7637] 2 exiting: rc = 0 00000100:00100000:2.0:1788748452.925558:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99ced1207e00:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1788748452.925691:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748452.926537:0:6711:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99cdc4c9f400:6711] 3 exiting: rc = 0 00000100:00100000:2.0:1788748452.927271:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99ceed76f200:5831] 2 exiting: rc = 0 00000100:00100000:2.0:1788748452.929428:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99cec8ba3c00:5829] 0 exiting: rc = 1 00000100:00100000:3.0:1788748452.930965:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99cec8ba2a00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788748452.931544:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931559:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931595:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931603:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931608:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931624:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931630:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931637:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931643:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931649:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931656:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931662:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931667:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931673:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931752:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931761:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931768:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931774:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931779:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931784:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931790:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931796:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931802:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931807:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931813:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931818:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931824:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931829:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931834:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931840:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931845:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931851:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931856:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931861:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931877:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931883:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931888:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931893:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931898:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931903:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931980:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931988:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931993:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.931999:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932004:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932009:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932106:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932113:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932119:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932204:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932211:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932216:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932222:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932484:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932492:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932497:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932504:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932510:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932515:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932521:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932526:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932532:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932537:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.932543:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788748452.935593:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748452.935605:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788748452.935611:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cefb0aa000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788748452.935627:0:13220:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefb0aa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788748452.935633:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788748452.935770:0:13220:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ceecebd000 1 00000020:00000080:1.0:1788748452.935777:0:13220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7be2a 00000020:00000080:1.0:1788748452.935784:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cefd78e000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788748452.935795:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788748452.935805:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748452.935811:0:13220:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1788748452.935849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd78e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:1.0:1788748452.935881:0:13220:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff99ceece74d40) has no exports 00000020:00000080:1.0:1788748452.959710:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748452.959726:0:13220:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788748452.959731:0:13220:0:(genops.c:885:class_export_put()) final put ffff99ceecebd800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788748452.959736:0:13220:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceecebd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788748452.959746:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788748452.960084:0:13220:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ceecebb000 00000020:01000000:1.0:1788748452.960117:0:13220:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788748452.960122:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748452.960126:0:13220:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788748452.960130:0:13220:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff99ceecf90000) has no exports 00000020:00000080:1.0:1788748452.960156:0:13220:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748452.960163:0:13220:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788748452.960166:0:13220:0:(genops.c:885:class_export_put()) final put ffff99cee52f8800/OSS_uuid 00000020:00000080:1.0:1788748452.960169:0:13220:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee52f8800/OSS_uuid for OSS 00000020:01000000:1.0:1788748452.960172:0:13220:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788748452.960199:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788748452.964837:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99cefd3c1800:6697] 2 exiting: rc = 0 00000100:00100000:1.0:1788748452.966376:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99cee0b32200:6696] 1 exiting: rc = 0 00000100:00100000:1.0:1788748452.966454:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99ceed716600:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1788748452.978376:0:8053:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99cef68ca000:8053] 3 exiting: rc = 0 00000100:00100000:1.0:1788748452.978451:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978464:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978471:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978476:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978492:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978498:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978503:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978508:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978526:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978531:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978536:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978540:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978545:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978550:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978555:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978560:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978564:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978569:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978574:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978579:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978584:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978589:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978593:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978598:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978603:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978607:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978622:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978627:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978632:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978638:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978643:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978647:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978652:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978658:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978662:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978667:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978672:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978690:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978696:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978701:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978706:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978711:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978717:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978729:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978734:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978740:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978745:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978751:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978756:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978762:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978768:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978773:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978779:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978785:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978790:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978796:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978801:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978807:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978812:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978818:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978823:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978833:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978839:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.978847:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748452.981282:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99cefd979600:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1788748452.981407:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99cefdbc6600:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1788748452.981523:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981534:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981540:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981546:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981551:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981557:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981562:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981568:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981572:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981577:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981582:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981587:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981593:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981598:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981634:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981639:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981644:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981649:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981654:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981660:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981665:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981671:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981688:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981693:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981699:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981704:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981710:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981715:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981721:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981726:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981730:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981735:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981739:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981745:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981751:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981757:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981763:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981768:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981774:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981779:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981784:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981789:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981795:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981800:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981805:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981809:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981815:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981820:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981825:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981839:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981844:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981849:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981853:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981858:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981863:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981868:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981873:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981878:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981884:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981889:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981894:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981899:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.981904:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.982294:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.984329:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99cefdbc6800:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1788748452.984629:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99cefdbc7400:6702] 2 exiting: rc = 0 00000100:00100000:0.0:1788748452.989893:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99cefdbc7e00:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1788748452.991441:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991452:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991459:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991464:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991469:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991474:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991480:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991485:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991490:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991496:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991501:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991506:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991512:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991517:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991524:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991528:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991533:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991538:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991543:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991562:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991568:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991574:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991593:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991601:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991606:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991624:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991630:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991637:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991642:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991648:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991654:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991660:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991666:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991672:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991805:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991815:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991820:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991826:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991832:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991838:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991843:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991848:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991854:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991859:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991865:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991870:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991890:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991898:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991903:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991975:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991982:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991988:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991993:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.991998:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.992011:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993111:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993119:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993227:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993234:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993240:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993245:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993251:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993256:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748452.993263:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016276:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99cefdbc6a00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1788748453.016390:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99cefdbc7c00:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1788748453.016845:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016853:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016858:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016863:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016868:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016873:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016879:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016884:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016889:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016895:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016899:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.016904:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018537:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018544:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018548:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018554:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018559:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018564:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018569:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018574:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018578:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018583:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018588:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018593:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018627:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018632:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018637:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018642:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018646:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018651:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018656:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018661:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018666:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018670:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.018675:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.019579:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.019587:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.019592:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.019596:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025627:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025639:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025644:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025650:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025655:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025660:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025665:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025670:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025675:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025985:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025991:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.025996:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026001:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026006:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026010:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026034:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026039:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026045:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026050:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026055:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026079:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026545:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026556:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026560:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.026565:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748453.032863:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99cefdbc7000:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1788748453.033706:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ceed741e00:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1788748453.033775:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033786:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033794:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033800:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033807:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033814:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033820:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033830:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033836:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033855:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033863:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033869:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033875:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033881:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033886:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033893:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033898:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.033903:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034079:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034096:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034102:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034133:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034140:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034147:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034152:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034158:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034164:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034169:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034175:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034195:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034201:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034207:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034213:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034233:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034241:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034248:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034254:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034259:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034264:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034270:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034276:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034281:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034287:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034292:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034297:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034316:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034323:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034329:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034334:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034340:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034345:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034350:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034355:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034361:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034367:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034372:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034378:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034399:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034407:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034413:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034420:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034501:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034509:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748453.034522:0:13220:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788748453.056295:0:13220:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788748470.436388:0:13840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788748479.988236:0:14300:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748479.988241:0:14300:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788748479.988348:0:14300:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cefd703800 00000020:01000004:2.0:1788748479.988363:0:14300:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788748479.988379:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788748479.988404:0:14300:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99ceece74d40) 00000020:00000080:2.0:1788748479.988416:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788748480.007095:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788748480.012873:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788748480.013259:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 457: rc = 0 00100000:10000000:3.0:1788748480.013360:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 457: rc = 0 00100000:10000000:3.0:1788748480.013481:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:3.0:1788748480.015782:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:3.0:1788748480.015897:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:3.0:1788748480.016788:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788748480.016869:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 457: rc = 0 00100000:10000000:3.0:1788748480.017197:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 459: rc = 0 00100000:10000000:3.0:1788748480.021820:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 598: rc = 0 00100000:10000000:3.0:1788748480.021931:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 598: rc = 0 00100000:10000000:3.0:1788748480.022373:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 650: rc = 0 00100000:10000000:3.0:1788748480.022729:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.022952:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 650: rc = 0 00100000:10000000:3.0:1788748480.023245:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.023737:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.023969:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 650: rc = 0 00100000:10000000:3.0:1788748480.024295:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:3.0:1788748480.024738:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.024979:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.025875:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 650: rc = 0 00100000:10000000:3.0:1788748480.026164:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:3.0:1788748480.026572:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00100000:10000000:3.0:1788748480.027192:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 603: rc = 0 00100000:10000000:3.0:1788748480.027647:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 603: rc = 0 00100000:10000000:3.0:1788748480.027900:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 603: rc = 0 00100000:10000000:3.0:1788748480.028223:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 603: rc = 0 00100000:10000000:3.0:1788748480.028686:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 603: rc = 0 00100000:10000000:3.0:1788748480.028939:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 603: rc = 0 00100000:10000000:3.0:1788748480.029277:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 603: rc = 0 00100000:10000000:3.0:1788748480.029685:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 603: rc = 0 00100000:10000000:3.0:1788748480.029915:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 603: rc = 0 00100000:10000000:3.0:1788748480.033936:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 603: rc = 0 00100000:10000000:3.0:1788748480.034221:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 603: rc = 0 00100000:10000000:2.0:1788748480.036631:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 603: rc = 0 00100000:10000000:2.0:1788748480.036926:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 603: rc = 0 00100000:10000000:2.0:1788748480.038864:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 603: rc = 0 00100000:10000000:2.0:1788748480.039148:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 603: rc = 0 00100000:10000000:2.0:1788748480.040685:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 603: rc = 0 00100000:10000000:2.0:1788748480.041002:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 603: rc = 0 00100000:10000000:2.0:1788748480.042908:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 603: rc = 0 00100000:10000000:2.0:1788748480.043202:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 603: rc = 0 00100000:10000000:2.0:1788748480.046250:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 603: rc = 0 00100000:10000000:2.0:1788748480.046643:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 603: rc = 0 00100000:10000000:2.0:1788748480.046881:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 603: rc = 0 00100000:10000000:2.0:1788748480.047150:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 603: rc = 0 00100000:10000000:2.0:1788748480.047404:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 603: rc = 0 00100000:10000000:2.0:1788748480.049917:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 603: rc = 0 00100000:10000000:2.0:1788748480.050859:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 603: rc = 0 00100000:10000000:2.0:1788748480.051215:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 603: rc = 0 00100000:10000000:2.0:1788748480.051497:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 603: rc = 0 00100000:10000000:2.0:1788748480.051864:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 603: rc = 0 00100000:10000000:2.0:1788748480.054571:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 603: rc = 0 00100000:10000000:2.0:1788748480.054857:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 603: rc = 0 00100000:10000000:2.0:1788748480.055147:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 603: rc = 0 00100000:10000000:2.0:1788748480.055553:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 658: rc = 0 00100000:10000000:2.0:1788748480.056047:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788748480.056212:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 599: rc = 0 00100000:10000000:2.0:1788748480.056387:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788748480.056463:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 599: rc = 0 00100000:10000000:2.0:1788748480.056643:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788748480.056703:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 599: rc = 0 00100000:10000000:2.0:1788748480.057061:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788748480.057123:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1788748480.057299:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788748480.057361:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1788748480.061365:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788748480.061472:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00000020:00000080:2.0:1788748480.062886:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788748480.062895:0:14300:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748480.062905:0:14300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cf41 00000020:01000004:2.0:1788748480.062912:0:14300:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788748480.062917:0:14300:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788748480.062922:0:14300:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cefd703800 from MGS 00000020:01000004:2.0:1788748480.062926:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788748480.062935:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99ceece719c0) 00000020:00000080:2.0:1788748480.062945:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788748480.062993:0:14300:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cefd703800 from MGS, refs=2 00080000:01000000:2.0:1788748480.062998:0:14300:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788748480.063003:0:14300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cf4f 00000100:00100000:2.0:1788748480.063185:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788748480.063304:0:14300:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788748480.063311:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788748480.072825:0:14300:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788748480.072840:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788748480.073504:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748480.073662:0:14300:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788748480.073667:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788748480.079224:0:14300:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788748480.079238:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788748480.079592:0:14300:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788748480.079600:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788748480.080061:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748480.080064:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748480.080066:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.080411:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.080413:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.080415:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.080823:0:14300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788748480.089362:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788748480.091565:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788748480.091583:0:14300:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788748480.091586:0:14300:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788748480.096346:0:14309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788748480.096548:0:14300:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788748480.096661:0:14300:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788748480.097182:0:14300:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788748480.097468:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748480.097612:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788748480.097621:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788748480.111488:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788748480.111504:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788748480.112048:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788748480.112058:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788748480.113773:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788748480.113795:0:14300:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:2.0:1788748480.113797:0:14300:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788748480.113822:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:2.0:1788748480.113833:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (ffff99ceece73380) 00000020:00000080:2.0:1788748480.113848:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788748480.113919:0:14300:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ceecee9800@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788748480.114125:0:14300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:2.0:1788748480.114131:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788748480.119498:0:14314:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788748480.124281:0:14316:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788748480.124412:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid e9f57890-027b-4d36-a4ce-36a41fae69fb) 00000020:00000080:0.0:1788748480.124456:0:14300:0:(genops.c:1384:class_connect()) connect: client e9f57890-027b-4d36-a4ce-36a41fae69fb, cookie 0x5b377f42a7a7cf5d 00000100:00080000:0.0:1788748480.124470:0:14300:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748480.124485:0:14300:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff99ceecee9800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748480.124521:0:14300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc60b8a80 x1875638377072768/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748480.124552:0:14300:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e9f57890-027b-4d36-a4ce-36a41fae69fb->MGS 00000020:01000004:0.0:1788748480.124577:0:14300:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788748480.124583:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788748480.124609:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99cefd4a0000) 00000020:00000080:0.0:1788748480.124621:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788748480.132767:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9f57890-027b-4d36-a4ce-36a41fae69fb:3305:1875638377072768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788748480.132833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.133049:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377072768 00000100:00100000:1.0:1788748480.133059:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377072768 00000100:00100000:1.0:1788748480.133096:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748480.133104:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875638377072768:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788748480.133130:0:14310:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from e9f57890-027b-4d36-a4ce-36a41fae69fb@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:1.0:1788748480.133293:0:14310:0:(genops.c:1384:class_connect()) connect: client e9f57890-027b-4d36-a4ce-36a41fae69fb, cookie 0x5b377f42a7a7cf6b 00000100:00080000:1.0:1788748480.133415:0:14310:0:(import.c:65:import_set_state_nolock()) ffff99cef68b7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748480.133480:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:3305:x1875638377072768:12345-0@lo:250:mount.lustre.0 Request processed in 376us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.133488:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748480.133555:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788748480.133564:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1788748480.133571:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788748480.133575:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788748480.133578:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788748480.133581:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788748480.133595:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788748480.133599:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9f57890-027b-4d36-a4ce-36a41fae69fb:3305:1875638377072768:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788748480.142881:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748480.143102:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788748480.143109:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788748480.147230:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788748480.147244:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788748480.149584:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788748480.149596:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788748480.151341:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748480.151526:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788748480.151533:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788748480.152256:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788748480.152264:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788748480.197873:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748480.198100:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788748480.198107:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788748480.205886:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788748480.205902:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788748480.206668:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748480.206856:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788748480.206861:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788748480.213381:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788748480.213401:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788748480.215582:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748480.215757:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788748480.215763:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788748480.216320:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788748480.216327:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788748480.217081:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748480.217560:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788748480.217566:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788748480.218036:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788748480.218042:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788748480.254042:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748480.254238:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748480.254244:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788748480.256751:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788748480.256767:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788748480.260408:0:14300:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748480.260426:0:14300:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788748480.261496:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788748480.261520:0:14300:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788748480.261527:0:14300:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788748480.261663:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748480.261704:0:14300:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788748480.261709:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748480.261710:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748480.261711:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748480.261713:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748480.261714:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748480.261715:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748480.261717:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748480.261718:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748480.261720:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748480.261721:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748480.261724:0:14300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788748480.261727:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748480.261728:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748480.261729:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748480.261730:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748480.261731:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748480.261732:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748480.261733:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748480.261734:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748480.261735:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748480.261736:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748480.261764:0:14300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788748480.261785:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377072896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748480.261851:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.261892:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748480.261970:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377072896 00000100:00100000:0.0:1788748480.261978:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377072896 00000100:00100000:0.0:1788748480.262051:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748480.262062:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:14300:x1875638377072896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788748480.262106:0:14313:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788748480.262110:0:14313:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788748480.262113:0:14313:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788748480.262576:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788748480.262946:0:14313:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788748480.264520:0:14335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788748480.264529:0:14335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788748480.264532:0:14335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788748480.264578:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788748480.264864:0:14313:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788748480.264875:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788748480.278929:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:14300:x1875638377072896:12345-0@lo:253:mount.lustre.0 Request processed in 16859us (17067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.278944:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748480.279155:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377072896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788748480.279171:0:14300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788748480.279181:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748480.279183:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748480.279184:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748480.279185:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748480.279187:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748480.279188:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748480.279189:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748480.279190:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748480.279192:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748480.279193:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788748480.279212:0:14300:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cefd703800 from lustre-MDT0000 10000000:01000000:3.0:1788748480.279237:0:14300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788748480.279240:0:14300:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788748480.279245:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ceece73380 10000000:01000000:3.0:1788748480.279250:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748480.279258:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ceece73380 from 1 10000000:01000000:3.0:1788748480.279261:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748480.279299:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748480.279311:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748480.279321:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748480.279342:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748480.279377:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.279419:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48ba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.279565:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073024 00000100:00100000:1.0:1788748480.279572:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073024 00000100:00100000:1.0:1788748480.279613:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748480.279621:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:14300:x1875638377073024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748480.279633:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748480.279648:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9e00/0x5b377f42a7a7cf79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7cf72 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.279669:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9e00/0x5b377f42a7a7cf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf72 expref: 6 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.279680:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9e00/0x5b377f42a7a7cf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf72 expref: 6 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.279688:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9e00, rc 0) 00000100:00100000:1.0:1788748480.279732:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+6:14300:x1875638377073024:12345-0@lo:101:mount.lustre.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.279738:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748480.279814:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.279827:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.279836:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.279897:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748480.279934:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.279953:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.280060:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073152 00000100:00100000:1.0:1788748480.280065:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073152 00000100:00100000:1.0:1788748480.280095:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748480.280102:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+6:14300:x1875638377073152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748480.280331:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+6:14300:x1875638377073152:12345-0@lo:501:mount.lustre.0 Request processed in 229us (396us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748480.280338:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748480.280543:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073152:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788748480.280569:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788748480.280587:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.280594:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748480.280602:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cefd703800 10000000:01000000:2.0:1788748480.280606:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788748480.280610:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cefd703800 10000000:01000000:2.0:1788748480.280613:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788748480.280616:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99cefd703800 from 1 10000000:01000000:2.0:1788748480.280618:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788748480.280641:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.280648:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.280666:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.280679:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748480.280706:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.280727:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec9728180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748480.280785:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073280 00000100:00100000:0.0:1788748480.280790:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073280 00000100:00100000:0.0:1788748480.280809:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748480.280816:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+6:14300:x1875638377073280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.280823:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748480.280835:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7cf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7cf80 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.280851:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7cf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf80 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.280859:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7cf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf80 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.280867:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147ce00, rc 0) 00000100:00100000:0.0:1788748480.280911:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+7:14300:x1875638377073280:12345-0@lo:101:mount.lustre.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.280917:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748480.281050:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748480.281061:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.281069:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748480.281081:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788748480.281085:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.281091:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748480.281097:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788748480.281100:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748480.281104:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cefd703800 10000000:01000000:2.0:1788748480.281107:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788748480.281109:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788748480.281112:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788748480.281124:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.281136:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.281155:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.281167:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748480.281190:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.281209:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec9728180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748480.281298:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073408 00000100:00100000:0.0:1788748480.281303:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073408 00000100:00100000:0.0:1788748480.281321:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748480.281326:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+7:14300:x1875638377073408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.281333:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748480.281346:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7cf95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7cf8e expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.281359:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7cf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf8e expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.281366:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7cf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7cf8e expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.281372:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147d200, rc 0) 00000100:00100000:0.0:1788748480.281408:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+8:14300:x1875638377073408:12345-0@lo:101:mount.lustre.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.281413:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748480.281501:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748480.281514:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.281521:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.281562:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748480.281585:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.281611:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec9728180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.281673:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073536 00000100:00100000:1.0:1788748480.281677:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073536 00000100:00100000:1.0:1788748480.281696:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748480.281702:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+8:14300:x1875638377073536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748480.284838:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14300:x1875638377073536:12345-0@lo:501:mount.lustre.0 Request processed in 3126us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.284851:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748480.285004:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748480.285076:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748480.285130:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.285164:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec9728180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.285273:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073664 00000100:00100000:1.0:1788748480.285279:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073664 00000100:00100000:1.0:1788748480.285310:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748480.285317:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14300:x1875638377073664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748480.285681:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14300:x1875638377073664:12345-0@lo:503:mount.lustre.0 Request processed in 364us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.285689:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748480.286446:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377073664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748480.286952:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14336:1875638377073792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.287009:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.287069:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec97280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.287262:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377073792 00000100:00100000:1.0:1788748480.287278:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377073792 00000100:00100000:1.0:1788748480.287319:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748480.287327:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec50d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14336:x1875638377073792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748480.287618:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec50d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14336:x1875638377073792:12345-0@lo:502:llog_process_th.0 Request processed in 291us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.287625:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748480.290074:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14336:1875638377073792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748480.290124:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748480.290325:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748480.290329:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788748480.290337:0:14336:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788748480.290342:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748480.290357:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99ceece70000) 00000020:00000080:2.0:1788748480.290378:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788748480.290384:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788748480.290489:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788748480.290502:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cfa3 00000020:00000080:2.0:1788748480.290738:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788748480.290743:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748480.290746:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748480.290747:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788748480.290750:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748480.290753:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748480.290755:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788748480.290758:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748480.290765:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99ceecf90000) 00000020:00000080:2.0:1788748480.290776:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788748480.290779:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788748480.290781:0:14336:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788748480.290783:0:14336:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788748480.290788:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788748480.290824:0:14336:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cefd703800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788748480.290834:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99ceecf94d40) 00000020:00000080:2.0:1788748480.290840:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788748480.290882:0:14336:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788748480.290894:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7cfb8 00000020:00000080:2.0:1788748480.291178:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788748480.291184:0:14336:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788748480.291189:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b377f42a7a7cfbf 00080000:01000000:2.0:1788748480.291194:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788748480.291197:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cfc6 00010000:00010000:2.0:1788748480.428388:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788748480.429467:0:14336:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788748480.429660:0:14336:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788748480.430686:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ceecf919c0) 00000020:00000080:2.0:1788748480.430704:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788748480.430781:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788748480.430791:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cfd4 00000020:00000080:0.0:1788748480.437521:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788748480.454846:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b377f42a7a7cfdb 00000020:00000080:0.0:1788748480.461312:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788748480.461328:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748480.461337:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.461339:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788748480.461344:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788748480.461347:0:14336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788748480.461349:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748480.461351:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748480.461352:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788748480.461356:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.461357:0:14336:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788748480.461360:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748480.461365:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.461367:0:14336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788748480.461382:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788748480.461426:0:14336:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788748480.461450:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748480.461465:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.461467:0:14336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788748480.461470:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788748480.461474:0:14336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788748480.461477:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.461479:0:14336:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788748480.461482:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788748480.461488:0:14336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1788748480.461513:0:14336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788748480.461516:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788748480.461530:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cefd4a4d40) 00000020:00000080:0.0:1788748480.461547:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788748480.461552:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788748480.461609:0:14336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788748480.461616:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788748480.461623:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cfe9 00010000:00080000:0.0:1788748480.461653:0:14336:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cec6630800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788748480.461873:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788748480.463796:0:14336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788748480.463847:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788748480.474864:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748480.474964:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788748480.475079:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788748480.480699:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788748480.480709:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788748480.481528:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748480.481540:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788748480.481586:0:14336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788748480.481608:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7cff0 00000100:00080000:3.0:1788748480.481618:0:14336:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748480.481628:0:14336:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cec6630800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748480.481664:0:14336:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730c700 x1875638377073920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748480.481693:0:14336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788748480.481747:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748480.481751:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748480.481753:0:14336:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788748480.481755:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788748480.481758:0:14336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788748480.481759:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748480.481761:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748480.481762:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788748480.481765:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748480.481766:0:14336:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788748480.481769:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748480.481773:0:14336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788748480.481776:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748480.481777:0:14336:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788748480.481780:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748480.481784:0:14336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788748480.481804:0:14336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788748480.481806:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748480.481816:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cefb828000) 00000020:00000080:3.0:1788748480.481832:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788748480.481837:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748480.481887:0:14336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788748480.481893:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000100:00100000:2.0:1788748480.482006:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377073920:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788748480.482072:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377073920 offset 0 length 520: 4 00000020:00000080:3.0:1788748480.482197:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7cffe 00010000:00080000:3.0:1788748480.482360:0:14336:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cec44ca000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748480.482679:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788748480.482875:0:14336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788748480.482898:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788748480.484529:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748480.484610:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788748480.484687:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788748480.486739:0:14342:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788748480.486745:0:14342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788748480.492466:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748480.492480:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788748480.492518:0:14336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788748480.492538:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d005 00000100:00080000:1.0:1788748480.492547:0:14336:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748480.492558:0:14336:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748480.492595:0:14336:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc5c93b80 x1875638377074048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748480.492624:0:14336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788748480.492681:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748480.492686:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748480.492688:0:14336:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788748480.492691:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748480.492695:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748480.492696:0:14336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748480.492700:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748480.492702:0:14336:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748480.492704:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748480.492707:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748480.492708:0:14336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788748480.492710:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748480.492712:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748480.492714:0:14336:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748480.492718:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788748480.492747:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14336:1875638377074176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748480.492818:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.492854:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec329f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.493084:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377074048:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788748480.493113:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377074048 offset 0 length 520: 4 00000100:00100000:0.0:1788748480.493374:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074176 00000100:00100000:0.0:1788748480.493382:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074176 00000100:00100000:0.0:1788748480.493441:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748480.493451:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14336:x1875638377074176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748480.493710:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14336:x1875638377074176:12345-0@lo:502:llog_process_th.0 Request processed in 259us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.493723:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748480.493836:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14336:1875638377074176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748480.493864:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748480.493869:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748480.493871:0:14336:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788748480.493875:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788748480.494187:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788748480.494214:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788748480.494236:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.494247:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748480.494256:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cefd703800 from 1 10000000:01000000:0.0:1788748480.494258:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748480.494287:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.494295:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.494304:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.494318:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748480.494351:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.494513:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec6410240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.495844:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074304 00000100:00100000:2.0:1788748480.495855:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074304 00000100:00100000:2.0:1788748480.495891:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748480.495898:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+9:14300:x1875638377074304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748480.497312:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748480.497339:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d00c expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.497369:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.497381:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.497405:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:2.0:1788748480.497488:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+10:14300:x1875638377074304:12345-0@lo:101:mount.lustre.0 Request processed in 1589us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.497495:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748480.497613:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.497631:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.497640:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.498380:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074432:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788748480.498445:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.498486:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec6410240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.498580:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074432 00000100:00100000:2.0:1788748480.498587:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074432 00000100:00100000:2.0:1788748480.498625:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748480.498634:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+10:14300:x1875638377074432:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788748480.498650:0:14310:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788748480.498656:0:14310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788748480.498724:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+10:14300:x1875638377074432:12345-0@lo:256:mount.lustre.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.498731:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748480.500094:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074432:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788748480.500852:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748480.500969:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.500982:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748480.500990:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cefd703800 from 1 10000000:01000000:0.0:1788748480.500993:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748480.501048:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.501056:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.501066:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.501087:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748480.501154:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.501186:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec6410240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.501912:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074560 00000100:00100000:2.0:1788748480.501921:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074560 00000100:00100000:2.0:1788748480.501974:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748480.501984:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+10:14300:x1875638377074560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748480.501997:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748480.502033:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d01a expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.502057:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.502067:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.502091:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748480.502138:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377074560:12345-0@lo:101:mount.lustre.0 Request processed in 156us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.502144:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748480.502624:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.502698:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.502709:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.502772:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748480.502803:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.502834:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec6410240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.503009:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074688 00000100:00100000:1.0:1788748480.503026:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074688 00000100:00100000:1.0:1788748480.503057:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748480.503065:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377074688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748480.503637:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377074688:12345-0@lo:501:mount.lustre.0 Request processed in 571us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.503645:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748480.503916:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748480.503954:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748480.503998:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.504049:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec6410240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.504164:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074816 00000100:00100000:2.0:1788748480.504170:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074816 00000100:00100000:2.0:1788748480.504216:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748480.504225:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377074816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748480.504376:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377074816:12345-0@lo:503:mount.lustre.0 Request processed in 152us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.504383:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748480.504632:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377074816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748480.505198:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14344:1875638377074944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748480.505459:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.505483:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cece62e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.505546:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377074944 00000100:00100000:2.0:1788748480.505552:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377074944 00000100:00100000:2.0:1788748480.505590:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748480.505598:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14344:x1875638377074944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.505798:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14344:x1875638377074944:12345-0@lo:502:llog_process_th.0 Request processed in 200us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.505806:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748480.506057:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14344:1875638377074944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748480.506083:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748480.506092:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.506095:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788748480.506102:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cefd703800 00000020:00000080:0.0:1788748480.506104:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748480.506112:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748480.506114:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.506116:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788748480.506127:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748480.506132:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.506133:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788748480.506137:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cefd703800 00000020:00000080:0.0:1788748480.506152:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748480.506279:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748480.506284:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.506285:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788748480.506288:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748480.506290:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748480.506292:0:14344:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788748480.506296:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cefd703800 00000020:00000080:0.0:1788748480.506298:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788748480.506337:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14344:1875638377075072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748480.506373:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.506405:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cece62e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.507298:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075072 00000100:00100000:2.0:1788748480.507305:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075072 00000100:00100000:2.0:1788748480.507350:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748480.507358:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14344:x1875638377075072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.507566:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14344:x1875638377075072:12345-0@lo:502:llog_process_th.0 Request processed in 209us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.507574:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748480.507635:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14344:1875638377075072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748480.507661:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748480.507668:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748480.507670:0:14344:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788748480.507674:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788748480.509159:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788748480.509190:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748480.510056:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510071:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748480.510124:0:14300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748480.510127:0:14300:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cefd703800 10000000:01000000:0.0:1788748480.510130:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cefd703800 10000000:01000000:0.0:1788748480.510135:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748480.510149:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cefd703800 from 1 10000000:01000000:0.0:1788748480.510153:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748480.510188:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510213:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510225:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.510249:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748480.510306:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.510345:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cece62ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748480.510369:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075200 00000100:00100000:0.0:1788748480.510375:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075200 00000100:00100000:0.0:1788748480.510413:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748480.510423:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377075200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.510445:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748480.510457:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147cc00/0x5b377f42a7a7d02f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d028 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510480:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147cc00/0x5b377f42a7a7d02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d028 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510490:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147cc00/0x5b377f42a7a7d02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d028 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510498:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147cc00, rc 0) 00000100:00100000:0.0:1788748480.510536:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075200:12345-0@lo:101:mount.lustre.0 Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.510542:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748480.510593:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748480.510608:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.510617:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748480.510662:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748480.510686:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.510702:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cece62ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.518318:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075328 00000100:00100000:2.0:1788748480.518331:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075328 00000100:00100000:2.0:1788748480.518384:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748480.518393:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748480.518690:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075328:12345-0@lo:501:mount.lustre.0 Request processed in 297us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.518698:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748480.519080:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748480.519128:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748480.520528:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.520578:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cece62ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.521317:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075456 00000100:00100000:2.0:1788748480.521327:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075456 00000100:00100000:2.0:1788748480.521374:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748480.521384:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748480.521608:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075456:12345-0@lo:503:mount.lustre.0 Request processed in 224us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.521616:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748480.521714:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748480.533947:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14346:1875638377075584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.534053:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.534096:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1bb5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748480.539524:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075584 00000100:00100000:3.0:1788748480.539539:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075584 00000100:00100000:3.0:1788748480.539594:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748480.539605:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14346:x1875638377075584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748480.539915:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14346:x1875638377075584:12345-0@lo:502:llog_process_th.0 Request processed in 311us (5861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748480.539924:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748480.540178:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14346:1875638377075584:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788748480.540247:0:14346:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788748480.540261:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ceecf93380) 00000020:00000080:2.0:1788748480.540282:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788748480.540364:0:14346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cefd703800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788748480.540368:0:14346:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cefd703800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788748480.540371:0:14346:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cefd703800 4 00010000:00080000:2.0:1788748480.540398:0:14346:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ced141a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788748480.542057:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788748480.542248:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788748480.542282:0:14346:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748480.542293:0:14346:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b377f42a7a7d03d 00000100:00080000:2.0:1788748480.542303:0:14346:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748480.542313:0:14346:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ced141a800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748480.542346:0:14346:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb631180 x1875638377075712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748480.542382:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377075712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748480.542451:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.542515:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075712 00000100:00100000:2.0:1788748480.542521:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075712 00000100:00100000:2.0:1788748480.542547:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748480.542554:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377075712:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748480.542599:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377075712:12345-0@lo:38:llog_process_th.0 Request processed in 44us (149us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788748480.542606:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748480.542638:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748480.542645:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced141a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748480.542658:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788748480.542662:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377075712:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788748480.542691:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788748480.552680:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14346:1875638377075840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.552767:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.552803:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075840 00000100:00100000:2.0:1788748480.552809:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075840 00000100:00100000:2.0:1788748480.552846:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748480.552854:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cecdc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14346:x1875638377075840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748480.553124:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cecdc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14346:x1875638377075840:12345-0@lo:502:llog_process_th.0 Request processed in 270us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.553132:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748480.554397:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1bb5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.554438:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9f57890-027b-4d36-a4ce-36a41fae69fb:14346:1875638377075840:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788748480.554477:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788748480.554558:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788748480.554583:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748480.554602:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748480.554614:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788748480.554657:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788748480.554659:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748480.554660:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748480.554661:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748480.554667:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748480.554668:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748480.554669:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748480.554671:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748480.554672:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748480.554674:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748480.554677:0:14300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788748480.554679:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748480.554680:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748480.554681:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748480.554906:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748480.554908:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748480.554910:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748480.554911:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748480.554912:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748480.554913:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748480.554914:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748480.554934:0:14300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788748480.554958:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075968:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748480.555146:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.555172:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748480.559331:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377075968 00000100:00100000:2.0:1788748480.559345:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377075968 00000100:00100000:2.0:1788748480.559400:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748480.559412:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14300:x1875638377075968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788748480.559454:0:14313:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788748480.559469:0:14313:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788748480.633945:0:14313:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748480.633974:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788748480.634299:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788748480.634304:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788748480.634327:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.634345:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.634354:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.634425:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.634448:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 12 pid: 14312 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.634461:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377076096:0@lo:104: 00000100:00100000:2.0:1788748480.634523:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.634586:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748480.634768:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076096 00000100:00100000:1.0:1788748480.634775:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076096 00000100:00100000:1.0:1788748480.634815:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748480.634823:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377076096:12345-0@lo:104: 00010000:00010000:1.0:1788748480.634841:0:14301:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.634905:0:14301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748480.634911:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377076096:12345-0@lo:104: Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.634918:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788748480.634938:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748480.634943:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.634951:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748480.634955:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.634973:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748480.634980:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748480.634986:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748480.635010:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.635040:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748480.635058:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.635064:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d013 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748480.635088:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.635089:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748480.635091:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748480.635110:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748480.635119:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377076224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748480.635146:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.635405:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377076096:0@lo:104: 00010000:00010000:2.0:1788748480.635423:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.635481:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076224 00000100:00100000:2.0:1788748480.635485:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076224 00010000:00010000:2.0:1788748480.635502:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 13 pid: 14312 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.635532:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748480.635539:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+13:3309:x1875638377076224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748480.635549:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748480.635553:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 13 pid: 14312 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635562:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 13 pid: 14312 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635575:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7d013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d00c expref: 13 pid: 14312 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635603:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635761:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748480.635774:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001471093s 00010000:00010000:2.0:1788748480.635779:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635786:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635793:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635799:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635804:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748480.635808:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635815:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635828:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635836:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748480.635874:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3309:x1875638377076224:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.635880:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788748480.635898:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635904:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748480.635910:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d044 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748480.635932:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377076224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748480.649236:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14300:x1875638377075968:12345-0@lo:253:mount.lustre.0 Request processed in 89819us (94082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.649252:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748480.649276:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:14300:1875638377075968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748480.649295:0:14300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788748480.649299:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748480.649301:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748480.649302:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748480.649303:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748480.649305:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748480.649306:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748480.649307:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748480.649308:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748480.649310:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748480.649311:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748480.649326:0:14300:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788748480.663412:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748480.663588:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748480.663860:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748480.664058:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748480.664326:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748480.664812:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748480.666317:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748480.667108:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748480.667847:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748480.668192:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748480.668565:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748480.668810:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788748480.715415:0:14300:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788748480.715988:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788748480.716183:0:14357:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788748480.716187:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788748480.718521:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788748480.718776:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748480.724301:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748480.724391:0:14358:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788748480.724396:0:14358:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788748480.728695:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788748480.728822:0:14300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788748480.729318:0:14300:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788748480.729326:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788748480.729462:0:14300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748480.736700:0:14300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788748480.741356:0:14300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788748480.741439:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788748480.744191:0:14300:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788748480.751760:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788748480.767145:0:14300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788748480.868144:0:14300:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788748480.868184:0:14300:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6f5429cf988 00100000:10000000:2.0:1788748480.868192:0:14300:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788748480.884339:0:14300:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748480.884357:0:14300:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748480.884374:0:14300:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788748480.884401:0:14300:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788748481.134836:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748481.197273:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788748481.197281:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cefd703800 from 6 10000000:01000000:3.0:1788748481.197285:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788748481.197333:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197361:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197373:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748481.197399:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377076352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748481.197475:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748481.197598:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed427540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748481.200507:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076352 00000100:00100000:2.0:1788748481.200523:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076352 00000100:00100000:2.0:1788748481.200588:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748481.200598:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14316:x1875638377076352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748481.200614:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748481.200632:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d04b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200657:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200668:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200677:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2600, rc 0) 00000100:00100000:2.0:1788748481.200764:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377076352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748481.200771:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748481.201061:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377076352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748481.201081:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748481.201091:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748481.201170:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377076480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788748481.201209:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748481.201233:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748481.201416:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076480 00000100:00100000:1.0:1788748481.201432:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076480 00000100:00100000:1.0:1788748481.201470:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748481.201477:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377076480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788748481.201493:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748481.201508:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748481.201511:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788748481.201591:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377076480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748481.201598:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748481.202306:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377076480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788748481.202352:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748481.202360:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748481.202370:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748481.581492:0:14351:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748481.581522:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748481.581953:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788748481.581961:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788748482.157317:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748482.606784:0:14351:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748482.606793:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748482.607408:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788748482.607479:0:14351:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748482.607517:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1788748483.181272:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748484.205175:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748485.233501:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748485.485305:0:14601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788748485.871625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748485.871632:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748485.871635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748485.871637:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748485.871640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788748485.871653:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788748485.871657:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ced141a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748485.871672:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ced141a800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748485.871693:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb633100 x1875638377076736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748485.871738:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377076608:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.872553:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.872627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377076736:0@lo:38:kworker.0 00000100:00100000:2.0:1788748485.872657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.872698:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076736 00000100:00100000:2.0:1788748485.872705:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076736 00000100:00100000:2.0:1788748485.872754:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748485.872762:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875638377076736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788748485.872786:0:14320:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:2.0:1788748485.873490:0:14320:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b377f42a7a7d059 00000004:00100000:2.0:1788748485.873505:0:14320:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788748485.873629:0:14320:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748485.873685:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875638377076736:12345-0@lo:38:kworker.0 Request processed in 922us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748485.873707:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748485.873769:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cefb633100 x1875638377076736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748485.873784:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788748485.873790:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788748485.873795:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748485.873815:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced141a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748485.873821:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377076736:0@lo:38:kworker.0 00000100:00100000:3.0:1788748485.873929:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076608 00000100:00100000:3.0:1788748485.873935:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076608 00000100:00100000:3.0:1788748485.873972:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788748485.873980:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3309:x1875638377076608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748485.874040:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3309:x1875638377076608:12345-0@lo:400:kworker.0 Request processed in 60us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748485.874046:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748485.875004:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377076608:0@lo:400:kworker.0 00010000:00010000:2.0:1788748486.269780:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748487.281790:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748488.304256:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748488.556219:0:14753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9ea3d3f0 20000000:00000080:1.0:1788748488.556236:0:14753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ceed972000 uarg=0000000000000000 20000000:01000000:1.0:1788748488.556270:0:14753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788748488.556276:0:14753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788748488.556280:0:14753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788748488.563616:0:14754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788748488.564897:0:14753:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788748488.576617:0:14753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788748488.576647:0:14753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.576665:0:14753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.576673:0:14753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.576716:0:14753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.576733:0:14753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748488.576746:0:14753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14753:1875638377076864:0@lo:104: 00000100:00100000:1.0:1788748488.576808:0:14753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748488.576876:0:14753:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748488.576896:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076864 00000100:00100000:2.0:1788748488.576906:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076864 00000100:00100000:2.0:1788748488.576946:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748488.576955:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14753:x1875638377076864:12345-0@lo:104: 00010000:00010000:2.0:1788748488.576970:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577047:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748488.577054:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14753:x1875638377076864:12345-0@lo:104: Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748488.577059:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788748488.577099:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748488.577108:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748488.577115:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748488.577119:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748488.577127:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748488.577134:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748488.577140:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788748488.577192:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748488.577199:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748488.577221:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748488.577228:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d021 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748488.577250:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748488.577252:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748488.577261:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748488.577287:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377076992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748488.577320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748488.577359:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377076992 00000100:00100000:2.0:1788748488.577364:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377076992 00010000:00010000:2.0:1788748488.577393:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 12 pid: 14310 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748488.577422:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748488.577428:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3306:x1875638377076992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748488.577438:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748488.577442:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 12 pid: 14310 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577451:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 12 pid: 14310 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577475:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577483:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577495:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577513:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577521:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577527:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577532:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748488.577536:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577543:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577557:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748488.577566:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748488.577598:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3306:x1875638377076992:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748488.577617:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748488.577658:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377076992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748488.577798:0:14753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3800/0x5b377f42a7a7d021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d01a expref: 11 pid: 14310 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748488.577809:0:14753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14753:1875638377076864:0@lo:104: 00010000:00010000:1.0:1788748488.577821:0:14753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.577829:0:14753:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.577835:0:14753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748488.577842:0:14753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9600/0x5b377f42a7a7d060 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748489.329685:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788748490.094085:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748490.094096:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cefd703800 from 10 10000000:01000000:2.0:1788748490.094104:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748490.094167:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748490.094183:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748490.094196:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748490.094230:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748490.094322:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748490.094404:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec2b1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748490.094486:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377077120 00000100:00100000:1.0:1788748490.094498:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377077120 00000100:00100000:1.0:1788748490.094566:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748490.094577:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+11:14316:x1875638377077120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748490.094594:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748490.094611:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d067 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748490.094641:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748490.094654:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748490.094664:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8400, rc 0) 00000100:00100000:1.0:1788748490.094733:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377077120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748490.094739:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748490.095088:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748490.095108:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748490.095120:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748490.095193:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748490.095223:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748490.095251:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec2b1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748490.097041:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377077248 00000100:00100000:1.0:1788748490.097059:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377077248 00000100:00100000:1.0:1788748490.097128:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748490.097139:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377077248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748490.097659:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377077248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748490.097668:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748490.098258:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748490.098324:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748490.098401:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748490.098448:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec2b1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748490.099428:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377077376 00000100:00100000:1.0:1788748490.099442:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377077376 00000100:00100000:1.0:1788748490.099525:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748490.099537:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377077376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748490.100265:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:14316:x1875638377077376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 725us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748490.100276:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748490.100593:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377077376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748490.104990:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788748490.110011:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788748490.110081:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748490.110095:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748490.110110:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748490.355371:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788748490.995332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748490.995340:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748490.995343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748490.995346:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748490.995397:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748490.995422:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377077504:0@lo:400:kworker.0 00000100:00100000:2.0:1788748490.995514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748490.995581:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377077632:0@lo:400:kworker.0 00000100:00100000:2.0:1788748490.995614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748490.995677:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377077504 00000100:00100000:2.0:1788748490.995688:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377077504 00000100:00100000:2.0:1788748490.995744:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788748490.995754:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3306:x1875638377077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748490.995810:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:3306:x1875638377077504:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748490.995818:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788748490.995866:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377077632 00000100:00100000:2.0:1788748490.995870:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377077632 00000100:00100000:2.0:1788748490.995897:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748490.995916:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377077632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748490.995956:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377077632:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748490.995962:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748490.996006:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377077504:0@lo:400:kworker.0 00010000:00080000:2.0:1788748490.996079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cefb633100 x1875638377077632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748490.996092:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377077632:0@lo:400:kworker.0 00000100:00100000:0.0:1788748490.997864:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748480/real 1788748480] req@ffff99cdc5c93b80 x1875638377074048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748490.997897:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdc5c93b80 x1875638377074048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748490.997908:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748480/real 1788748480] req@ffff99cef730c700 x1875638377073920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748490.997920:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cef730c700 x1875638377073920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748490.997941:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748490.997967:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748490.997971:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377074048:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788748490.997977:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748490.997982:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748490.997985:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377073920:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788748490.998093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748490.998100:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788748490.998105:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748490.998111:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:3.0:1788748490.998118:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788748490.998147:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cec6630800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748490.998195:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730ce00 x1875638377077760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748490.998234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748490.998238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788748490.998239:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748490.998243:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:3.0:1788748490.998246:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788748490.998251:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748490.998265:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730d880 x1875638377077888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748490.998384:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377077760:0@lo:8:kworker.0 00000400:00000100:0.0:1788748490.998452:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377077760 offset 0 length 520: 4 00000100:00100000:0.0:1788748490.998495:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377077888:0@lo:8:kworker.0 00000400:00000100:0.0:1788748490.998522:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377077888 offset 0 length 520: 4 00010000:00010000:2.0:1788748491.374870:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748492.404698:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748492.856441:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748493.428576:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748494.445386:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788748494.747465:0:15003:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788748494.747471:0:15003:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788748494.747601:0:15003:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cec31d3800 00000020:01000004:0.0:1788748494.747623:0:15003:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788748494.747638:0:15003:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788748494.747655:0:15003:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99cefd4a3380) 00000020:00000080:0.0:1788748494.747673:0:15003:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788748494.791752:0:15003:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788748494.792253:0:15003:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788748494.794801:0:15003:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788748494.795544:0:15003:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788748494.796173:0:15003:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788748494.796650:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788748494.803459:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788748494.803582:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788748494.809469:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1788748494.809961:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1788748494.812157:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1788748494.812492:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1788748494.812766:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1788748494.813130:0:15003:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:2.0:1788748494.813824:0:15003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788748494.813845:0:15003:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748494.813858:0:15003:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7d07c 00000020:01000004:2.0:1788748494.813868:0:15003:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788748494.813894:0:15003:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788748494.813899:0:15003:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788748494.813905:0:15003:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788748494.813910:0:15003:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788748494.813931:0:15003:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ced2343380) 00000020:00000080:2.0:1788748494.813944:0:15003:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788748494.821271:0:15003:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748494.821514:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748494.821522:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788748494.838186:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748494.838218:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788748494.838792:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748494.838801:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788748494.854733:0:15003:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748494.854928:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788748494.854935:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788748494.856643:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788748494.856659:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788748494.897482:0:15003:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748494.897805:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748494.897812:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788748494.901762:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788748494.901778:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788748494.906614:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788748494.906631:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788748494.909458:0:15003:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748494.909661:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748494.909667:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788748494.911991:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788748494.912004:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788748494.987537:0:15003:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748494.987762:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788748494.987771:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788748494.990374:0:15003:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788748494.990391:0:15003:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788748494.991089:0:15003:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788748494.991113:0:15003:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788748494.991119:0:15003:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788748495.014479:0:15003:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788748495.014517:0:15003:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788748495.014522:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788748495.014523:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.014525:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.014526:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.014528:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.014529:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.014530:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.014532:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.014538:0:15003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748495.014542:0:15003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788748495.014544:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748495.014545:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.014546:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.014547:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.014548:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.014549:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.014550:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.014551:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.014552:0:15003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748495.014589:0:15003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788748495.014609:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788748495.014676:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748495.014744:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefc3c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748495.016691:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078016 00000100:00100000:1.0:1788748495.016705:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078016 00000100:00100000:1.0:1788748495.016764:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748495.016774:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:15003:x1875638377078016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788748495.016808:0:14313:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788748495.016812:0:14313:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788748495.016816:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788748495.039211:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:15003:x1875638377078016:12345-0@lo:253:mount.lustre.0 Request processed in 22428us (24524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.039225:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748495.039339:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788748495.039356:0:15003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788748495.039360:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748495.039361:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.039363:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.039364:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.039365:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.039366:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.039368:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.039370:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.039372:0:15003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748495.039394:0:15003:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cec31d3800 from lustre-OST0000 10000000:01000000:2.0:1788748495.039423:0:15003:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788748495.039426:0:15003:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788748495.039433:0:15003:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ceece73380 local copy 00010000:00010000:2.0:1788748495.039442:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748495.039659:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748495.039704:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748495.039744:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefc3c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.039798:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078144 00000100:00100000:0.0:1788748495.039813:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078144 00000100:00100000:0.0:1788748495.039855:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748495.039864:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:15003:x1875638377078144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748495.040043:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:15003:x1875638377078144:12345-0@lo:501:mount.lustre.0 Request processed in 181us (338us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748495.040051:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748495.040160:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788748495.040173:0:15003:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788748495.040287:0:15003:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788748495.040293:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.040300:0:15003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748495.040316:0:15003:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cec31d3800 10000000:01000000:1.0:1788748495.040320:0:15003:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788748495.040323:0:15003:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ceece73380 10000000:01000000:1.0:1788748495.040325:0:15003:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788748495.040327:0:15003:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99ceece73380 from 1 10000000:01000000:1.0:1788748495.040346:0:15003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788748495.040375:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.040386:0:15003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.040395:0:15003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748495.040409:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748495.040435:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.040464:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedeb15240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748495.040674:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078272 00000100:00100000:3.0:1788748495.040679:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078272 00000100:00100000:3.0:1788748495.040716:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748495.040725:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+12:15003:x1875638377078272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748495.040733:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748495.040748:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536ee00/0x5b377f42a7a7d091 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d08a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.040769:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536ee00/0x5b377f42a7a7d091 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d08a expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.040797:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536ee00/0x5b377f42a7a7d091 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d08a expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.040806:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ee00, rc 0) 00000100:00100000:3.0:1788748495.040846:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+13:15003:x1875638377078272:12345-0@lo:101:mount.lustre.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748495.040852:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748495.042191:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748495.042212:0:15003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.042223:0:15003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748495.042243:0:15003:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788748495.042261:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.042269:0:15003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748495.042277:0:15003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788748495.042282:0:15003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748495.042297:0:15003:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788748495.042299:0:15003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748495.042325:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.042347:0:15003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.042356:0:15003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748495.042372:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748495.042414:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.042451:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedeb15240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748495.042724:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078400 00000100:00100000:3.0:1788748495.042731:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078400 00000100:00100000:3.0:1788748495.042774:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788748495.042782:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+13:15003:x1875638377078400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748495.042802:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748495.042814:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536fe00/0x5b377f42a7a7d09f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d098 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.042831:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536fe00/0x5b377f42a7a7d09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d098 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.042841:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536fe00/0x5b377f42a7a7d09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d098 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.042849:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fe00, rc 0) 00000100:00100000:3.0:1788748495.042894:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078400:12345-0@lo:101:mount.lustre.0 Request processed in 112us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748495.042900:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748495.043049:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748495.043060:0:15003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.043068:0:15003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748495.043711:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788748495.044732:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748495.045181:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788748495.045229:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788748495.045263:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788748495.045328:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788748495.045379:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788748495.045411:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788748495.045477:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788748495.045493:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788748495.045590:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748495.045656:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.045714:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedeb159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748495.045798:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078528 00000100:00100000:2.0:1788748495.045806:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078528 00000100:00100000:2.0:1788748495.045855:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748495.045867:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748495.050151:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078528:12345-0@lo:501:mount.lustre.0 Request processed in 4275us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.050179:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748495.050690:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748495.052411:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748495.052490:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.052601:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb6150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.052653:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078656 00000100:00100000:0.0:1788748495.052660:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078656 00000100:00100000:0.0:1788748495.052748:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748495.052758:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748495.053146:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078656:12345-0@lo:503:mount.lustre.0 Request processed in 389us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.053154:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748495.053249:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748495.053864:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748495.053927:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748495.053973:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.054385:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedeb159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748495.054473:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078784 00000100:00100000:3.0:1788748495.054479:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078784 00000100:00100000:3.0:1788748495.054509:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748495.054518:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748495.054743:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078784:12345-0@lo:502:mount.lustre.0 Request processed in 226us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748495.054752:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748495.054870:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748495.055131:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788748495.055179:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788748495.055213:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788748495.055262:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788748495.055297:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788748495.055344:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788748495.055394:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788748495.055430:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788748495.055465:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788748495.055522:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788748495.055558:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788748495.055617:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788748495.055652:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748495.055698:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.055932:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecfa530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.056055:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377078912 00000100:00100000:0.0:1788748495.056062:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377078912 00000100:00100000:0.0:1788748495.056099:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748495.056107:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748495.056273:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377078912:12345-0@lo:502:mount.lustre.0 Request processed in 166us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.056289:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748495.056407:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377078912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748495.056480:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788748495.056489:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788748495.057648:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788748495.057659:0:15017:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788748495.057666:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.057669:0:15017:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788748495.057674:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788748495.057689:0:15017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99cefd4a19c0) 00000020:00000080:0.0:1788748495.057712:0:15017:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788748495.057718:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788748495.057781:0:15017:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec31d3800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788748495.057846:0:15017:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788748495.057853:0:15017:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7d0ad 00010000:00010000:0.0:1788748495.061828:0:15017:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788748495.062578:0:15017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788748495.065696:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788748495.067114:0:15017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788748495.067129:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748495.067136:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067138:0:15017:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788748495.067141:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788748495.067144:0:15017:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788748495.067146:0:15017:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748495.067147:0:15017:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748495.067149:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788748495.067151:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067152:0:15017:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788748495.067155:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748495.067157:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067158:0:15017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748495.067161:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748495.067163:0:15017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788748495.067165:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748495.067174:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067176:0:15017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788748495.067179:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748495.067181:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067182:0:15017:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748495.067185:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788748495.067238:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748495.067242:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748495.067243:0:15017:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788748495.067246:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788748495.072931:0:15003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788748495.072978:0:15003:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788748495.073119:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.073132:0:15003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748495.073755:0:15003:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec31d3800 from 1 10000000:01000000:3.0:1788748495.073760:0:15003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748495.073810:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.073819:0:15003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.073830:0:15003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748495.073854:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748495.073918:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.073961:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb615600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.074092:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079040 00000100:00100000:0.0:1788748495.074099:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079040 00000100:00100000:0.0:1788748495.074154:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748495.074163:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:15003:x1875638377079040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748495.074177:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748495.074189:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d0b4 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.074213:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 15 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.074224:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 15 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.074232:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec147c000, rc 0) 00000100:00100000:0.0:1788748495.074272:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079040:12345-0@lo:101:mount.lustre.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.074279:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788748495.076454:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748495.076487:0:15003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.076501:0:15003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748495.080471:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788748495.082065:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748495.082395:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788748495.082440:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788748495.082503:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788748495.082512:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788748495.082721:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748495.082909:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.082978:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079168 00000100:00100000:0.0:1788748495.082985:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079168 00000100:00100000:0.0:1788748495.083058:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788748495.083062:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb6156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.083074:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748495.083345:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079168:12345-0@lo:501:mount.lustre.0 Request processed in 272us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.083354:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788748495.083383:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748495.083423:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748495.083461:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.083486:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb6156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.083498:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079296 00000100:00100000:0.0:1788748495.083502:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079296 00000100:00100000:0.0:1788748495.083561:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788748495.083569:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748495.083715:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079296:12345-0@lo:503:mount.lustre.0 Request processed in 146us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.083722:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748495.083803:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788748495.084283:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748495.084364:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748495.084399:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.086766:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb6156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748495.087213:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079424 00000100:00100000:1.0:1788748495.087223:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079424 00000100:00100000:1.0:1788748495.087269:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748495.087279:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748495.087667:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079424:12345-0@lo:502:mount.lustre.0 Request processed in 389us (3266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.087676:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748495.088923:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748495.090317:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788748495.090415:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788748495.090490:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788748495.090674:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788748495.090715:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788748495.090759:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788748495.091715:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788748495.091777:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788748495.092110:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748495.092190:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.092238:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb6156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748495.092240:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079552 00000100:00100000:1.0:1788748495.092248:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079552 00000100:00100000:1.0:1788748495.092289:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748495.092299:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748495.092508:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079552:12345-0@lo:502:mount.lustre.0 Request processed in 210us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.092516:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748495.092636:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748495.092740:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788748495.092751:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788748495.100148:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748495.100179:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100181:0:15021:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788748495.100189:0:15021:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec31d3800 00000020:00000080:3.0:1788748495.100192:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748495.100200:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748495.100203:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100204:0:15021:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788748495.100207:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748495.100209:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100211:0:15021:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788748495.100214:0:15021:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec31d3800 00000020:00000080:3.0:1788748495.100216:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748495.100272:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748495.100277:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100278:0:15021:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788748495.100281:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748495.100284:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100285:0:15021:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788748495.100289:0:15021:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cec31d3800 00000020:00000080:3.0:1788748495.100291:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748495.100327:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748495.100340:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748495.100341:0:15021:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788748495.100345:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788748495.102417:0:15003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788748495.102460:0:15003:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748495.102489:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.102503:0:15003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748495.102560:0:15003:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748495.102563:0:15003:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cec31d3800 10000000:01000000:0.0:1788748495.102566:0:15003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cec31d3800 10000000:01000000:0.0:1788748495.102571:0:15003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748495.102578:0:15003:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec31d3800 from 1 10000000:01000000:0.0:1788748495.102581:0:15003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748495.102618:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.102627:0:15003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.102648:0:15003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748495.102673:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748495.102739:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.102771:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748495.102841:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079680 00000100:00100000:2.0:1788748495.102849:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079680 00000100:00100000:2.0:1788748495.102894:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748495.102903:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377079680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748495.102925:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748495.102937:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec2200/0x5b377f42a7a7d0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d0c2 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.102964:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec2200/0x5b377f42a7a7d0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0c2 expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.102974:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec2200/0x5b377f42a7a7d0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0c2 expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.102982:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2200, rc 0) 00000100:00100000:2.0:1788748495.103042:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377079680:12345-0@lo:101:mount.lustre.0 Request processed in 140us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748495.103049:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748495.103442:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748495.103458:0:15003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748495.103468:0:15003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748495.104053:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788748495.107671:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748495.107983:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788748495.108058:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788748495.108096:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788748495.111423:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788748495.111493:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788748495.111544:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788748495.111580:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788748495.111615:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788748495.111664:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788748495.111696:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788748495.111724:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788748495.111763:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788748495.114877:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788748495.114970:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788748495.115269:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788748495.115313:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788748495.115360:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788748495.115410:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788748495.115444:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788748495.115477:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788748495.115538:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788748495.115570:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788748495.115603:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788748495.115649:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788748495.115685:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788748495.115719:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788748495.115766:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788748495.115803:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788748495.115892:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788748495.115900:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788748495.116008:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748495.116092:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.116144:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748495.116997:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079808 00000100:00100000:1.0:1788748495.117007:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079808 00000100:00100000:1.0:1788748495.117083:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748495.117093:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377079808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748495.117362:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377079808:12345-0@lo:501:mount.lustre.0 Request processed in 270us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.117370:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748495.120957:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748495.121049:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748495.121268:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.121311:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb509300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748495.123133:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377079936 00000100:00100000:1.0:1788748495.123149:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377079936 00000100:00100000:1.0:1788748495.123216:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748495.123239:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377079936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748495.123491:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377079936:12345-0@lo:503:mount.lustre.0 Request processed in 253us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.123498:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748495.123896:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377079936:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788748495.126517:0:15003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748495.126619:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748495.126703:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.128858:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748495.137493:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080064 00000100:00100000:2.0:1788748495.137511:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080064 00000100:00100000:2.0:1788748495.137572:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788748495.137583:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377080064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748495.137883:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377080064:12345-0@lo:502:mount.lustre.0 Request processed in 301us (11179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748495.137892:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748495.139963:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748495.140667:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788748495.140732:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788748495.140768:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788748495.140839:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788748495.140891:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788748495.140940:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788748495.140975:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788748495.141008:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788748495.141091:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788748495.141888:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788748495.141929:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788748495.141987:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788748495.142051:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788748495.142090:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788748495.142893:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788748495.142939:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788748495.142976:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788748495.148545:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788748495.148651:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788748495.148691:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788748495.148764:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788748495.148803:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788748495.148837:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788748495.148883:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788748495.148920:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788748495.148956:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788748495.149004:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788748495.149063:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788748495.149097:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788748495.151031:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788748495.151113:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788748495.152392:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788748495.152428:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788748495.152491:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788748495.154411:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788748495.154499:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788748495.154551:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788748495.154580:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788748495.154627:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788748495.154664:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788748495.154713:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748495.154783:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.157788:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080192 00000100:00100000:3.0:1788748495.157797:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080192 00000100:00100000:3.0:1788748495.157843:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748495.157852:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377080192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748495.158231:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377080192:12345-0@lo:502:mount.lustre.0 Request processed in 378us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748495.158240:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748495.158439:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748495.158465:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748495.159671:0:15003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788748495.159693:0:15003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788748495.166381:0:15026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788748495.166401:0:15026:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ced2340000) 00000020:00000080:2.0:1788748495.166425:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788748495.166659:0:15026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec31d3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788748495.166664:0:15026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec31d3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788748495.166667:0:15026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec31d3800 3 00010000:00080000:2.0:1788748495.166699:0:15026:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ceecebd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788748495.170736:0:15026:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788748495.171189:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788748495.171230:0:15026:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748495.171242:0:15026:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b377f42a7a7d0d7 00000100:00080000:2.0:1788748495.171251:0:15026:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748495.171263:0:15026:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ceecebd000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748495.171298:0:15026:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb631180 x1875638377080320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748495.171326:0:15026:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748495.171390:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377080320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788748495.171462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748495.171569:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080320 00000100:00100000:1.0:1788748495.171576:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080320 00000100:00100000:1.0:1788748495.171624:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748495.171631:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377080320:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788748495.171655:0:14318:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1788748495.171691:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b377f42a7a7d0de 00000004:00100000:1.0:1788748495.171706:0:14318:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788748495.171734:0:14318:0:(import.c:65:import_set_state_nolock()) ffff99cee516d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748495.171810:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875638377080320:12345-0@lo:38:llog_process_th.0 Request processed in 178us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.171818:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788748495.171864:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cefb631180 x1875638377080320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748495.171875:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748495.171884:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788748495.171892:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788748495.171898:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788748495.171900:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788748495.171906:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377080320:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788748495.172463:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788748495.172531:0:15003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788748495.172561:0:15003:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748495.172578:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.172600:0:15003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788748495.172670:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788748495.172672:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.172673:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.172674:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.172676:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.172677:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.172679:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.172681:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.172682:0:15003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748495.172686:0:15003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788748495.172688:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748495.172690:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.172691:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.172692:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.172698:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.172700:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.172701:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.172702:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.172702:0:15003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748495.172721:0:15003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788748495.172735:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788748495.172794:0:15003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748495.172820:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefc3c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748495.172843:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080448 00000100:00100000:2.0:1788748495.172848:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080448 00000100:00100000:2.0:1788748495.172878:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748495.172885:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15003:x1875638377080448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788748495.172919:0:14313:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788748495.172934:0:14313:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788748495.173813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748495.173819:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748495.173830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748495.173833:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788748495.173889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748495.173899:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788748495.173949:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.173987:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080576 00000100:00100000:0.0:1788748495.173991:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080576 00000100:00100000:0.0:1788748495.174043:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748495.174050:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748495.174087:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377080576:12345-0@lo:400:kworker.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748495.174093:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748495.174273:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdc60b8e00 x1875638377080576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748495.174287:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377080576:0@lo:400:kworker.0 20000000:01000000:2.0:1788748495.220321:0:14313:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788748495.220350:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788748495.220918:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788748495.220937:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788748495.220957:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.220975:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.220984:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.221059:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.221075:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 16 pid: 14312 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748495.221089:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377080704:0@lo:104: 00000100:00100000:3.0:1788748495.221154:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748495.221201:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb615300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748495.221522:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080704 00000100:00100000:2.0:1788748495.221531:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080704 00000100:00100000:2.0:1788748495.221580:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748495.221590:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377080704:12345-0@lo:104: 00010000:00010000:2.0:1788748495.221605:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748495.221673:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748495.221679:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377080704:12345-0@lo:104: Request processed in 92us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748495.221686:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788748495.221726:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748495.221734:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.221744:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748495.221748:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.221756:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748495.221763:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748495.221778:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748495.221822:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.221828:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748495.221858:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.221866:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536f600/0x5b377f42a7a7d04b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d052 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.221881:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748495.221883:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748495.221885:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748495.221909:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377080832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748495.221943:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748495.222074:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377080704:0@lo:104: 00010000:00010000:0.0:1788748495.222100:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748495.222250:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080832 00000100:00100000:1.0:1788748495.222255:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080832 00010000:00010000:1.0:1788748495.222274:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 17 pid: 14312 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748495.222304:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748495.222311:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:3306:x1875638377080832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748495.222322:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748495.222327:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 17 pid: 14312 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222348:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 17 pid: 14312 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222362:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec2600/0x5b377f42a7a7d052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d04b expref: 17 pid: 14312 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222382:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222391:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748495.222404:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001471093s 00010000:00010000:1.0:1788748495.222409:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222416:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222423:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222430:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222437:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fc00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748495.222441:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222448:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222479:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748495.222490:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748495.222538:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377080832:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748495.222546:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748495.223884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377080832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748495.224091:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.224102:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748495.224110:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748495.231776:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:15003:x1875638377080448:12345-0@lo:253:mount.lustre.0 Request processed in 58882us (58972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748495.231804:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748495.232222:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15003:1875638377080448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788748495.232246:0:15003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788748495.232250:0:15003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748495.232251:0:15003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748495.232253:0:15003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748495.232254:0:15003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748495.232256:0:15003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748495.232257:0:15003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748495.232259:0:15003:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748495.232260:0:15003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748495.232262:0:15003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788748495.232278:0:15003:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788748495.241383:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748495.241743:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748495.241892:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748495.242068:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748495.242278:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748495.244380:0:15003:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788748495.249099:0:15003:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788748495.339751:0:15003:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788748495.339762:0:15003:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788748495.339862:0:15003:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748495.340264:0:15003:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748495.340280:0:15003:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788748495.340313:0:15003:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788748495.469127:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748496.302737:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748496.302743:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cefd703800 from 7 10000000:01000000:0.0:1788748496.302749:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748496.302797:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748496.302820:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748496.302833:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748496.302859:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377080960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748496.302924:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748496.302974:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748496.303050:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377080960 00000100:00100000:3.0:1788748496.303058:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377080960 00000100:00100000:3.0:1788748496.303125:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748496.303134:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:14316:x1875638377080960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748496.303149:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748496.303163:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d0ec expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748496.303186:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748496.303196:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748496.303205:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fc00, rc 0) 00000100:00100000:3.0:1788748496.303269:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:14316:x1875638377080960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748496.303285:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748496.303350:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377080960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748496.303366:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748496.303376:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748496.303431:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377081088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788748496.303465:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748496.303532:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602480 going to sleep for 11 seconds 00000100:00100000:3.0:1788748496.303564:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081088 00000100:00100000:3.0:1788748496.303569:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081088 00000100:00100000:3.0:1788748496.303630:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788748496.303638:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:14316:x1875638377081088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788748496.303652:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748496.303668:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748496.303672:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788748496.303762:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:14316:x1875638377081088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748496.303770:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748496.303995:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377081088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748496.304072:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748496.304080:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748496.304089:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748496.493154:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748497.523803:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748498.541439:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748499.566530:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748500.205978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748500.205986:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788748500.205989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748500.206002:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788748500.206066:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748500.206085:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377081216:0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748500.206204:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377081472:0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206233:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748500.206262:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748500.206268:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377081344:0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206292:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748500.206329:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081216 00000100:00100000:1.0:1788748500.206337:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081216 00000100:00100000:1.0:1788748500.206381:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748500.206390:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206450:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377081216:12345-0@lo:400:kworker.0 Request processed in 60us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748500.206457:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748500.206492:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081472 00000100:00100000:1.0:1788748500.206495:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081472 00000100:00100000:1.0:1788748500.206524:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081344 00000100:00100000:1.0:1788748500.206527:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081344 00000100:00100000:1.0:1788748500.206540:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748500.206546:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377081472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206580:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377081472:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748500.206587:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748500.206598:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748500.206611:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377081344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206642:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377081344:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748500.206660:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788748500.206719:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc5c90e00 x1875638377081344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748500.206735:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377081344:0@lo:400:kworker.0 00010000:00080000:1.0:1788748500.206748:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc5c91500 x1875638377081472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748500.206756:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377081472:0@lo:400:kworker.0 00000100:00100000:1.0:1788748500.206785:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377081216:0@lo:400:kworker.0 00000100:00080000:0.0:1788748500.207177:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748500.590883:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748501.614526:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748502.000594:0:15370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788748502.066365:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748502.642354:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748503.661851:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748504.685208:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748505.328555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748505.328564:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748505.328567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748505.328571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788748505.329001:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377081600:0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.329129:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748505.329202:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748505.329209:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.329239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748505.329281:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748505.329290:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377081856:0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.329314:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748505.329352:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081600 00000100:00100000:1.0:1788748505.329377:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081600 00000100:00100000:1.0:1788748505.329447:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748505.329457:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377081600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.329518:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377081600:12345-0@lo:400:kworker.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748505.329525:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748505.329565:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081728 00000100:00100000:1.0:1788748505.329569:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081728 00000100:00100000:1.0:1788748505.329597:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081856 00000100:00100000:1.0:1788748505.329599:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081856 00000100:00100000:1.0:1788748505.329626:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748505.329633:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.330420:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377081728:12345-0@lo:400:kworker.0 Request processed in 785us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748505.330430:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748505.330457:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748505.330465:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377081856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.330503:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377081856:12345-0@lo:400:kworker.0 Request processed in 40us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748505.330509:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788748505.330545:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788748505.330585:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc60b9180 x1875638377081856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748505.330602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377081856:0@lo:400:kworker.0 00010000:00080000:1.0:1788748505.330655:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc60baa00 x1875638377081728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748505.330692:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788748505.330706:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377081600:0@lo:400:kworker.0 00000100:00100000:0.0:1788748505.393899:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748490/real 1788748490] req@ffff99cef730ce00 x1875638377077760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748505.393939:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cef730ce00 x1875638377077760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748505.393952:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748490/real 1788748490] req@ffff99cef730d880 x1875638377077888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748505.393964:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cef730d880 x1875638377077888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748505.394041:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748505.394079:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748505.394084:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377077760:0@lo:8:kworker.0 00000100:00080000:0.0:1788748505.394091:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748505.394096:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748505.394099:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377077888:0@lo:8:kworker.0 00000100:00080000:2.0:1788748505.394449:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748505.394457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788748505.394462:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748505.394469:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788748505.394476:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748505.394491:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cec6630800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748505.394540:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb631880 x1875638377081984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748505.394605:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377081984:0@lo:8:kworker.0 00000100:00100000:1.0:1788748505.394706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748505.394747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748505.394752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748505.394755:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748505.394760:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788748505.394764:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748505.394772:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748505.394791:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb632a00 x1875638377082112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748505.394795:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377081984 00000100:00100000:1.0:1788748505.394805:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377081984 00000100:00100000:2.0:1788748505.394842:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377082112:0@lo:8:kworker.0 00000100:00100000:1.0:1788748505.394851:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748505.394860:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875638377081984:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788748505.394878:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788748505.394905:0:15005:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1788748505.394942:0:15005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d0fa 00002000:00100000:1.0:1788748505.394960:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cee516b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788748505.394964:0:15005:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788748505.394968:0:15005:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788748505.395362:0:15006:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748505.395373:0:15006:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788748505.395388:0:15007:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748505.395398:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082112 00000100:00100000:3.0:1788748505.395402:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082112 00002000:00080000:1.0:1788748505.395428:0:15005:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748505.395460:0:15005:0:(import.c:65:import_set_state_nolock()) ffff99cee516f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748505.395519:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638377081984:12345-0@lo:8:kworker.0 Request processed in 659us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748505.395527:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748505.395548:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748505.395553:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875638377082112:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788748505.395564:0:15005:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748505.395593:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875638377082112:12345-0@lo:8:kworker.0 Request processed in 38us (715us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788748505.395598:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788748505.398577:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748505.398594:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748505.398601:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377082112:0@lo:8:kworker.0 00010000:00080000:0.0:1788748505.398628:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cefb631880 x1875638377081984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748505.398641:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748505.398652:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788748505.398664:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788748505.398682:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788748505.398686:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788748505.398712:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788748505.398720:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377081984:0@lo:8:kworker.0 00000004:00080000:3.0:1788748505.399612:0:14341:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788748505.399641:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875638377082368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788748505.399736:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748505.399778:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5187000 going to sleep for 11 seconds 00000004:00080000:3.0:1788748505.399802:0:14340:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788748505.400434:0:14340:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422443418651ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788748505.401772:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082368 00000100:00100000:3.0:1788748505.401787:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082368 00000100:00100000:3.0:1788748505.401923:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748505.401936:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1875638377082368:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788748505.402990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748505.403046:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377082240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748505.403134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748505.403191:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748505.404285:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082240 00000100:00100000:3.0:1788748505.404314:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082240 00000100:00100000:3.0:1788748505.404391:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748505.404403:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377082240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748505.404451:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748505.404549:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377082240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748505.404557:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748505.404624:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730c000 x1875638377082240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748505.404648:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377082240:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788748505.409775:0:15007:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788748505.409792:0:15007:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788748505.409799:0:15007:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1788748505.429694:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.429710:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431023:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.431035:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.431047:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431076:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431091:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431113:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431141:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.431162:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.431170:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431179:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.431913:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.431994:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.432042:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.432050:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d101 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.432074:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.432076:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.432078:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.435415:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.435443:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.435464:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.435469:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.435476:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.435494:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.435505:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.435514:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.435589:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748505.436431:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.436442:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.436454:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.436458:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.436463:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.436475:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.436493:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.436500:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436603:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748505.436613:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436622:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ea00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748505.436628:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436639:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436663:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436672:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9f9846/0x5b377f42a7a7d108 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436695:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748505.436699:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436706:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748505.436709:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.436724:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.436801:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748505.436814:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748505.437007:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.437040:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d10f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.437054:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748505.437055:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748505.437057:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.437714:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.437723:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438065:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.438071:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.438079:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438093:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438105:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438113:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438155:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748505.438636:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.438643:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438653:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.438657:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.438662:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438671:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438680:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438688:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438706:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788748505.438718:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748505.438724:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438745:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.438756:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438765:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438782:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438790:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d116 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438808:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.438811:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438818:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.438821:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438829:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438839:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438846:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d11d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.438867:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.438868:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.438870:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748505.440207:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.440674:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.440686:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.440705:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.440710:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.440718:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.441282:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.441299:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.441307:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.443172:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748505.443698:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748505.443710:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.443726:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ec00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.443742:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.443757:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.443788:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.443797:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffff39c9/0x5b377f42a7a7d124 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748505.444509:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.444519:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.444547:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.444552:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.444560:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.444575:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.444586:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.444593:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.444621:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748505.445096:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.445104:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445114:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.445118:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.445122:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445133:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445155:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445162:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445172:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748505.445638:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.445644:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445653:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.445656:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.445661:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445670:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445679:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445686:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.445707:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788748505.446191:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.446198:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446207:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.446210:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.446215:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446225:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446233:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446240:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446248:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788748505.446666:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.446672:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446682:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.446691:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.446696:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446706:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446714:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446722:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.446730:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788748505.447149:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.447155:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.447164:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.447166:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.447170:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.447180:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.447189:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.447202:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.447210:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788748505.448882:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788748505.448898:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.448915:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.448921:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449046:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449075:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449084:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050140159/0x5b377f42a7a7d12b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449107:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788748505.449111:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449118:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.449121:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449129:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449140:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449148:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d132 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449174:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748505.449179:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449258:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.449270:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449279:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449291:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449299:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d139 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449313:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748505.449317:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449324:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.449327:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449352:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449364:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449372:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537032fe/0x5b377f42a7a7d140 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449388:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748505.449393:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449399:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.449403:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449412:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449423:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449430:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a166fbb/0x5b377f42a7a7d147 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449456:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748505.449461:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449468:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748505.449471:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449479:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449490:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449497:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0ae168e/0x5b377f42a7a7d14e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748505.449511:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748505.449513:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748505.449516:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748505.449533:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.454464:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.454482:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454505:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.454510:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.454519:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454537:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454549:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454559:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454587:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.454608:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.454615:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454635:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.454640:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454650:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454671:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454679:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001454e0a1/0x5b377f42a7a7d155 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.454701:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.454703:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.454706:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.461126:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.461145:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461168:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.461173:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.461180:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461286:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461307:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461315:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461340:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.461358:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.461365:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461373:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.461378:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461388:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461408:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461417:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bc72b4b/0x5b377f42a7a7d15c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.461439:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.461447:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.461449:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.463332:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.463347:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463368:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.463373:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.463381:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463397:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463410:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463417:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463440:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.463456:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.463463:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463471:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.463476:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463503:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463522:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463530:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d286880/0x5b377f42a7a7d163 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.463556:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.463558:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.463560:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.464448:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.464458:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464471:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.464475:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.464481:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464491:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464500:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464514:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464536:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.464550:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.464555:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464562:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.464566:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464573:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464586:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464593:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594e5a9a/0x5b377f42a7a7d16a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.464610:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.464612:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.464613:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.465607:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.465626:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465639:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.465643:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.465650:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465662:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465671:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465680:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465702:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.465718:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.465723:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465731:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.465735:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465744:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465764:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465771:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d202b8/0x5b377f42a7a7d171 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.465791:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.465793:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.465795:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.467121:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.467136:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.467150:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.467154:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.467161:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.467174:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.467544:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.467555:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.467647:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748505.468413:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.468421:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.468434:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.468438:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.468443:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.468455:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.468464:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.468471:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.472866:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748505.472886:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.472903:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02056c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748505.472909:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.472923:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.472965:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.472988:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b97804c/0x5b377f42a7a7d178 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.473029:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748505.473033:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.473040:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cf02057400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748505.473043:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.473051:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.473062:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.473070:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748505.473071:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748505.473073:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.475665:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748505.475686:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd4d455/0x5b377f42a7a7d17f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.476295:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.480418:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.480452:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.480473:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.480480:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.480488:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482048:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482074:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482083:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748505.482103:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788748505.482143:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748505.482156:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.482163:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482171:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.482176:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482286:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482309:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482316:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d82f3b/0x5b377f42a7a7d186 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.482337:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.482338:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.482340:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748505.483682:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.483694:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.483710:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.483716:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.483723:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.483750:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.483762:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.483784:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.483809:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748505.485531:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748505.485544:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485561:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788748505.485566:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748505.485574:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485588:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485599:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485607:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485634:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788748505.485648:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748505.485654:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485670:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.485675:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485684:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485702:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485709:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60de87c/0x5b377f42a7a7d18d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485728:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748505.485842:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.485878:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485886:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.485890:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485898:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485909:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.485924:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f701107c/0x5b377f42a7a7d194 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748505.486939:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748505.486950:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.486965:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788748505.486976:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748505.486982:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.486995:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487005:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487037:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487062:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748505.487076:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788748505.487580:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748505.487588:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487598:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788748505.487601:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748505.487606:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487617:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487626:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487640:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.487651:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748505.488046:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748505.488052:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488061:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788748505.488064:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748505.488069:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488078:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488087:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488095:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488104:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788748505.488504:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748505.488511:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488525:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788748505.488528:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748505.488533:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488542:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488551:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488559:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488568:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788748505.488943:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748505.488950:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488958:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788748505.488961:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748505.488965:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488975:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.488994:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.489002:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748505.489011:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788748505.489205:0:15007:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:3.0:1788748505.489552:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788748505.489559:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489568:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.489573:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489583:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489603:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489612:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7d1a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489625:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748505.489629:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489635:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.489649:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489657:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489667:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489674:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ac6656/0x5b377f42a7a7d1a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489685:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748505.489688:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489694:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.489697:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489705:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489714:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489720:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d1b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489737:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748505.489740:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489747:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.489750:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489757:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489767:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489774:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0f783a/0x5b377f42a7a7d1b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.489785:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.489787:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.489789:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491452:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491467:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.491482:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748505.491488:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.491511:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.491534:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.491543:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9928f9/0x5b377f42a7a7d19b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748505.491567:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491569:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491572:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491577:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748505.491579:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748505.497611:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1875638377082368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95667us (97863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748505.497631:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748505.497852:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875638377082368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788748505.497876:0:14341:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788748505.498107:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875638377082496:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788748505.498162:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748505.498364:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748505.498441:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082496 00000100:00100000:3.0:1788748505.498451:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082496 00000100:00100000:3.0:1788748505.498513:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748505.498523:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14341:x1875638377082496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788748505.498584:0:15006:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788748505.506867:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14341:x1875638377082496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8332us (8692us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788748505.506883:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748505.507287:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875638377082496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788748505.507310:0:14341:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788748505.709476:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748506.031579:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788748506.031607:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788748506.735084:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748507.757354:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748508.794819:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748509.811918:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748510.445781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748510.445788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788748510.445804:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748510.445812:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:1.0:1788748510.445819:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788748510.445831:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748510.445856:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc5c93b80 x1875638377082880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748510.446052:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377082624:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.446159:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748510.446165:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377082752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.446218:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377083136:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446252:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.446268:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748510.446272:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377083008:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.446318:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082624 00000100:00100000:1.0:1788748510.446326:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082624 00000100:00100000:1.0:1788748510.446370:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748510.446379:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377082624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446430:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377082624:12345-0@lo:400:kworker.0 Request processed in 52us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.446437:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748510.446467:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082752 00000100:00100000:1.0:1788748510.446471:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082752 00000100:00100000:1.0:1788748510.446505:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748510.446519:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377082752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446550:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377082752:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.446556:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748510.446574:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083136 00000100:00100000:1.0:1788748510.446577:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083136 00000100:00100000:1.0:1788748510.446600:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083008 00000100:00100000:1.0:1788748510.446603:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083008 00000100:00100000:1.0:1788748510.446615:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748510.446633:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377083136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446666:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377083136:12345-0@lo:400:kworker.0 Request processed in 46us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.446673:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748510.446686:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748510.446692:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377083008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446718:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377083008:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.446723:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788748510.446745:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748510.446750:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788748510.446776:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc5c93800 x1875638377083008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748510.446790:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377083008:0@lo:400:kworker.0 00010000:00080000:1.0:1788748510.446802:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc5c90380 x1875638377083136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748510.446810:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377083136:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446852:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788748510.446864:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377082752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748510.446874:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377082624:0@lo:400:kworker.0 00000100:00100000:2.0:1788748510.447315:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748510.447326:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377083264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748510.447360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748510.448147:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083264 00000100:00100000:3.0:1788748510.448155:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083264 00000100:00100000:3.0:1788748510.448326:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748510.448335:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377083264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748510.448369:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748510.448429:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377083264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748510.448436:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748510.448488:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377083264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748510.451374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377082880:0@lo:8:kworker.0 00000100:00100000:0.0:1788748510.451448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.453047:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377082880 00000100:00100000:1.0:1788748510.453060:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377082880 00000100:00100000:1.0:1788748510.453111:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748510.453119:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1875638377082880:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788748510.453140:0:15495:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748510.487870:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1875638377082880:12345-0@lo:8:kworker.0 Request processed in 34743us (36415us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788748510.487886:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788748510.489729:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748510.489741:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788748510.489746:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377082880:0@lo:8:kworker.0 00010000:00010000:0.0:1788748510.829273:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788748510.838833:0:15725:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788748510.838837:0:15725:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788748510.838954:0:15725:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cec6526800 00000020:01000004:3.0:1788748510.838971:0:15725:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788748510.838987:0:15725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788748510.839003:0:15725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99cefb82cd40) 00000020:00000080:3.0:1788748510.839062:0:15725:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788748510.886410:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788748510.887143:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788748510.888288:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788748510.888603:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788748510.888985:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788748510.889545:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 521: rc = 0 00100000:10000000:1.0:1788748510.889666:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 521: rc = 0 00100000:10000000:1.0:1788748510.889955:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:1.0:1788748510.890622:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 658: rc = 0 00100000:10000000:1.0:1788748510.891281:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 658: rc = 0 00100000:10000000:1.0:1788748510.891629:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 658: rc = 0 00100000:10000000:1.0:1788748510.892188:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 658: rc = 0 00100000:10000000:1.0:1788748510.892542:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 658: rc = 0 00100000:10000000:1.0:1788748510.892953:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 658: rc = 0 00000020:00000080:1.0:1788748510.893791:0:15725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788748510.893803:0:15725:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788748510.893813:0:15725:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7d1c5 00000020:01000004:1.0:1788748510.893822:0:15725:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788748510.893844:0:15725:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788748510.893847:0:15725:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788748510.893924:0:15725:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788748510.893948:0:15725:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788748510.893952:0:15725:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788748510.907829:0:15725:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788748510.907936:0:15725:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788748510.907941:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788748510.907943:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748510.907945:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748510.907946:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748510.907947:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748510.907949:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748510.907950:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748510.907952:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748510.907953:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748510.907956:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788748510.907958:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748510.907959:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748510.907960:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748510.907962:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748510.907963:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748510.907964:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748510.907965:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748510.907966:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748510.907967:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748510.907995:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788748510.908109:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788748510.908188:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748510.908324:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec36023c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748510.908376:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083392 00000100:00100000:2.0:1788748510.908390:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083392 00000100:00100000:2.0:1788748510.908538:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788748510.908549:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15725:x1875638377083392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788748510.908582:0:14310:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788748510.908585:0:14310:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788748510.908589:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788748510.917388:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15725:x1875638377083392:12345-0@lo:253:mount.lustre.0 Request processed in 8832us (9191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748510.917403:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748510.917516:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748510.917549:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788748510.917552:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748510.917554:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748510.917555:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748510.917557:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748510.917558:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748510.917560:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748510.917561:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748510.917563:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748510.917564:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788748510.917584:0:15725:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cec6526800 from lustre-OST0001 10000000:01000000:0.0:1788748510.917613:0:15725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788748510.917616:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788748510.917623:0:15725:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ceece73380 local copy 00010000:00010000:0.0:1788748510.917633:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748510.917946:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748510.917982:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.918128:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748510.918240:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083520 00000100:00100000:1.0:1788748510.918247:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083520 00000100:00100000:1.0:1788748510.918336:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788748510.918347:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15725:x1875638377083520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748510.918643:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15725:x1875638377083520:12345-0@lo:501:mount.lustre.0 Request processed in 298us (660us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748510.918651:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788748510.918732:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083520:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788748510.918749:0:15725:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788748510.918978:0:15725:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788748510.918985:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.918994:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748510.919122:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cec6526800 10000000:01000000:0.0:1788748510.919134:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788748510.919139:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788748510.919141:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748510.919145:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788748510.919147:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788748510.919183:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.919192:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.919202:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748510.919215:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748510.919261:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.919422:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748510.919489:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083648 00000100:00100000:1.0:1788748510.919495:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083648 00000100:00100000:1.0:1788748510.919531:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748510.919540:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:15725:x1875638377083648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748510.919553:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748510.919566:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d1cc expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748510.919587:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1cc expref: 17 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748510.919598:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1cc expref: 17 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748510.919606:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748510.919683:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377083648:12345-0@lo:101:mount.lustre.0 Request processed in 144us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.919690:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748510.919888:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748510.919901:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.919909:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748510.920767:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788748510.922585:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748510.922921:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788748510.922968:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788748510.924963:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788748510.925113:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788748510.925285:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788748510.925327:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788748510.925412:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788748510.925420:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788748510.925534:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748510.925603:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.925647:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748510.925715:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083776 00000100:00100000:1.0:1788748510.925723:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083776 00000100:00100000:1.0:1788748510.925778:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788748510.925787:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377083776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748510.926527:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377083776:12345-0@lo:501:mount.lustre.0 Request processed in 737us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.926536:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748510.926632:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748510.926668:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748510.926709:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.926740:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748510.926920:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377083904 00000100:00100000:1.0:1788748510.926926:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377083904 00000100:00100000:1.0:1788748510.927007:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748510.927046:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377083904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748510.927371:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377083904:12345-0@lo:503:mount.lustre.0 Request processed in 355us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.927379:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788748510.927468:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377083904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788748510.928266:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748510.928339:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748510.928391:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.932069:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748510.932299:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084032 00000100:00100000:2.0:1788748510.932308:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084032 00000100:00100000:2.0:1788748510.932359:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748510.932367:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377084032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748510.932684:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377084032:12345-0@lo:502:mount.lustre.0 Request processed in 317us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748510.932693:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788748510.937083:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748510.937404:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788748510.937466:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788748510.937502:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788748510.937553:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788748510.937589:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788748510.937623:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788748510.937669:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788748510.937706:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788748510.937750:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788748510.937792:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748510.941717:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.941766:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748510.941940:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084160 00000100:00100000:2.0:1788748510.941949:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084160 00000100:00100000:2.0:1788748510.941989:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748510.942010:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377084160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748510.942314:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377084160:12345-0@lo:502:mount.lustre.0 Request processed in 316us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748510.942322:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788748510.943390:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748510.943524:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788748510.943540:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788748510.949593:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788748510.949724:0:15726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788748510.949732:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748510.949735:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788748510.949743:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748510.949758:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99ced2344d40) 00000020:00000080:2.0:1788748510.949778:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788748510.949784:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788748510.949923:0:15726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec6526800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788748510.949932:0:15726:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788748510.949940:0:15726:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7d1e1 00010000:00010000:2.0:1788748510.954700:0:15726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788748510.955643:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788748510.958964:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788748510.962432:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788748510.962446:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748510.962453:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748510.962455:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788748510.962458:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748510.962463:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748510.962464:0:15726:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748510.962467:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748510.962480:0:15726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788748510.962483:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748510.962485:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748510.962487:0:15726:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788748510.962489:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748510.962492:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748510.962493:0:15726:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788748510.962496:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788748510.962560:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748510.962565:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748510.962566:0:15726:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788748510.962570:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788748510.962717:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788748510.962744:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788748510.962770:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.962784:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748510.962792:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec6526800 from 1 10000000:01000000:0.0:1788748510.962795:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748510.962928:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.962938:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.962950:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748510.962972:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748510.963066:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.963105:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748510.963166:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084288 00000100:00100000:2.0:1788748510.963173:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084288 00000100:00100000:2.0:1788748510.963218:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748510.963237:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:15725:x1875638377084288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748510.963251:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748510.963264:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d1e8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748510.963288:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748510.963298:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748510.963305:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3a00, rc 0) 00000100:00100000:2.0:1788748510.963357:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084288:12345-0@lo:101:mount.lustre.0 Request processed in 131us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748510.963364:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788748510.963436:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748510.963465:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748510.963475:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748510.965147:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788748510.965513:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748510.965726:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788748510.965768:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788748510.969133:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788748510.969276:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788748510.969394:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748510.969454:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.969498:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7269c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748510.969783:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084416 00000100:00100000:3.0:1788748510.969791:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084416 00000100:00100000:3.0:1788748510.969849:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788748510.969859:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748510.970116:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084416:12345-0@lo:501:mount.lustre.0 Request processed in 258us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748510.970124:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748510.970303:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748510.970339:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084544:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748510.970376:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748510.970405:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb7269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748510.970472:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084544 00000100:00100000:2.0:1788748510.970477:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084544 00000100:00100000:2.0:1788748510.970510:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788748510.970517:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748510.970734:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084544:12345-0@lo:503:mount.lustre.0 Request processed in 217us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748510.970749:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788748510.970792:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788748510.972123:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748510.972206:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748510.972275:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748510.972315:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec8a0eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748510.972991:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084672 00000100:00100000:1.0:1788748510.973001:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084672 00000100:00100000:1.0:1788748510.973078:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788748510.973088:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748510.973358:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084672:12345-0@lo:502:mount.lustre.0 Request processed in 271us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748510.973366:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748510.974649:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748510.974945:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788748510.974998:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788748510.975084:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788748510.975125:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788748510.975167:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788748510.975218:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788748510.975265:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788748510.975294:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788748510.975332:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748510.975396:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748510.975440:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec8a0eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748510.975512:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084800 00000100:00100000:3.0:1788748510.975519:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084800 00000100:00100000:3.0:1788748510.975560:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748510.975568:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748510.975765:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084800:12345-0@lo:502:mount.lustre.0 Request processed in 197us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748510.975773:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788748510.975920:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748510.976001:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788748510.976011:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788748510.976920:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748510.976931:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.976934:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788748510.976940:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec6526800 00000020:00000080:1.0:1788748510.976943:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748510.976950:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748510.976953:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.976954:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788748510.976956:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748510.976957:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.976958:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748510.976971:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec6526800 00000020:00000080:1.0:1788748510.976973:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748510.977057:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748510.977061:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.977062:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788748510.977065:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748510.977067:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.977069:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748510.977072:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cec6526800 00000020:00000080:1.0:1788748510.977074:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748510.977115:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748510.977119:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748510.977120:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788748510.977123:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788748510.993735:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788748510.993780:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748510.993805:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.993829:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748510.993889:0:15725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788748510.993892:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cec6526800 10000000:01000000:3.0:1788748510.993895:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cec6526800 10000000:01000000:3.0:1788748510.993899:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748510.993905:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec6526800 from 1 10000000:01000000:3.0:1788748510.993908:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748510.993943:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.993953:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.993962:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748510.993983:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748510.994072:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748510.994117:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed6156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748510.997258:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377084928 00000100:00100000:3.0:1788748510.997275:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377084928 00000100:00100000:3.0:1788748510.997329:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748510.997340:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377084928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748510.997358:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748510.997374:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536e000/0x5b377f42a7a7d1fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d1f6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.997421:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536e000/0x5b377f42a7a7d1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1f6 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.997433:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536e000/0x5b377f42a7a7d1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1f6 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.997443:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e000, rc 0) 00000100:00100000:3.0:1788748510.997527:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377084928:12345-0@lo:101:mount.lustre.0 Request processed in 188us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748510.997535:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748510.997594:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377084928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748510.997615:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748510.997624:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748510.998273:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788748510.998725:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748510.998958:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788748510.999000:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788748510.999068:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788748510.999142:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788748510.999184:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788748511.011989:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788748511.012114:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788748511.012917:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788748511.013052:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788748511.013104:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788748511.013135:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788748511.013267:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788748511.013306:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788748511.013336:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788748511.013382:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788748511.013415:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788748511.013452:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788748511.013504:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788748511.013542:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788748511.013572:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788748511.013618:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788748511.013652:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788748511.013687:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788748511.013728:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788748511.013765:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788748511.013792:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788748511.015098:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788748511.015167:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788748511.015201:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788748511.015253:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788748511.015286:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788748511.015320:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788748511.015356:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788748511.015412:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788748511.015451:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788748511.015504:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788748511.015541:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788748511.015631:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788748511.015639:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788748511.015744:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748511.015823:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748511.015885:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed6156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748511.015969:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085056 00000100:00100000:1.0:1788748511.015977:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085056 00000100:00100000:1.0:1788748511.016043:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748511.016054:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748511.016318:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085056:12345-0@lo:501:mount.lustre.0 Request processed in 266us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748511.016327:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748511.016376:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748511.016413:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748511.016452:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748511.016478:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085184 00000100:00100000:1.0:1788748511.016482:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085184 00000100:00100000:1.0:1788748511.016504:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748511.016510:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748511.016766:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085184:12345-0@lo:503:mount.lustre.0 Request processed in 255us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748511.016780:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748511.016810:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748511.016823:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085184:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748511.017488:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748511.017555:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748511.017602:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748511.017636:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085312 00000100:00100000:1.0:1788748511.017641:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085312 00000100:00100000:1.0:1788748511.017670:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748511.017678:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748511.017898:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085312:12345-0@lo:502:mount.lustre.0 Request processed in 220us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748511.017906:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748511.017944:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748511.017961:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748511.018181:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788748511.020896:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788748511.020975:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788748511.021408:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788748511.021460:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788748511.021516:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788748511.021554:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788748511.021589:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788748511.021640:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788748511.021674:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788748511.021700:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788748511.021763:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788748511.021802:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788748511.023484:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788748511.023570:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788748511.023608:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788748511.023640:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788748511.023712:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788748511.023752:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788748511.023787:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788748511.026917:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788748511.027003:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788748511.027074:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788748511.027132:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788748511.027592:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788748511.027625:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788748511.027678:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788748511.027712:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788748511.027750:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788748511.027795:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788748511.027843:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788748511.027874:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788748511.027908:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788748511.027980:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788748511.028055:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788748511.028112:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788748511.028159:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788748511.028195:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788748511.028260:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788748511.028297:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788748511.028349:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748511.028424:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748511.028473:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748511.028716:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085440 00000100:00100000:3.0:1788748511.028725:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085440 00000100:00100000:3.0:1788748511.028776:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788748511.028785:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748511.029047:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377085440:12345-0@lo:502:mount.lustre.0 Request processed in 262us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748511.029056:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748511.029160:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377085440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748511.029247:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788748511.029257:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788748511.030273:0:15735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788748511.030289:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99cefb8299c0) 00000020:00000080:3.0:1788748511.030312:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788748511.030385:0:15735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec6526800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748511.030390:0:15735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec6526800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748511.030393:0:15735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec6526800 3 00010000:00080000:3.0:1788748511.030427:0:15735:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cf01940000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748511.033608:0:15735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788748511.034976:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788748511.035052:0:15735:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748511.035066:0:15735:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b377f42a7a7d20b 00000100:00080000:3.0:1788748511.035077:0:15735:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748511.035089:0:15735:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cf01940000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748511.035123:0:15735:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730d180 x1875638377085568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748511.035147:0:15735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748511.036933:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377085568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788748511.037007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788748511.037165:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788748511.037940:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085568 00000100:00100000:1.0:1788748511.037959:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085568 00000100:00100000:1.0:1788748511.037999:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748511.038006:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875638377085568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788748511.038054:0:14319:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1788748511.038089:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b377f42a7a7d212 00000004:00100000:1.0:1788748511.038107:0:14319:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788748511.038144:0:14319:0:(import.c:65:import_set_state_nolock()) ffff99cee516a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748511.038212:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875638377085568:12345-0@lo:38:llog_process_th.0 Request processed in 204us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748511.038219:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788748511.038282:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730d180 x1875638377085568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748511.038293:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748511.038301:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788748511.038309:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788748511.038314:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788748511.038315:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788748511.038320:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377085568:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788748511.038768:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748511.038773:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748511.038776:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748511.038781:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:2.0:1788748511.038793:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788748511.038801:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748511.038897:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cefb632680 x1875638377085824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748511.038953:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377085696:0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.038991:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.039055:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377085952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039080:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.039097:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748511.039102:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039126:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.039160:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085696 00000100:00100000:2.0:1788748511.039165:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085696 00000100:00100000:2.0:1788748511.039196:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748511.039204:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377085696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039257:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377085696:12345-0@lo:400:kworker.0 Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748511.039264:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748511.039283:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085952 00000100:00100000:2.0:1788748511.039286:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085952 00000100:00100000:2.0:1788748511.039307:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086080 00000100:00100000:2.0:1788748511.039310:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086080 00000100:00100000:2.0:1788748511.039322:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748511.039328:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377085952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039362:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377085952:12345-0@lo:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748511.039368:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748511.039388:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748511.039394:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377086080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039424:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377086080:12345-0@lo:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748511.039429:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748511.039459:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377085696:0@lo:400:kworker.0 00010000:00080000:2.0:1788748511.039484:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cefb630a80 x1875638377086080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748511.039494:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377086080:0@lo:400:kworker.0 00010000:00080000:2.0:1788748511.039502:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cefb631500 x1875638377085952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748511.039511:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377085952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748511.039526:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377085824:0@lo:8:kworker.0 00000100:00100000:2.0:1788748511.039567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.039593:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377085824 00000100:00100000:2.0:1788748511.039597:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377085824 00000100:00100000:2.0:1788748511.039615:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748511.039620:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875638377085824:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788748511.039660:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875638377085824:12345-0@lo:8:kworker.0 Request processed in 39us (94us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788748511.039666:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748511.039688:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748511.039693:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748511.039696:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788748511.039699:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377085824:0@lo:8:kworker.0 00000020:01000000:0.0:1788748511.051053:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788748511.051103:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748511.051126:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748511.051893:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788748511.051952:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788748511.051954:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748511.051955:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748511.051957:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748511.051958:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748511.051960:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748511.051961:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748511.051963:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748511.051964:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748511.051968:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788748511.051971:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748511.051972:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748511.051973:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748511.051975:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748511.051976:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748511.051977:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748511.051978:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748511.051979:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748511.051980:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748511.052007:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788748511.052122:0:15725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377086208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748511.052321:0:15725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748511.052397:0:15725:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefb726480 going to sleep for 11 seconds 00000100:00100000:3.0:1788748511.058317:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086208 00000100:00100000:3.0:1788748511.058335:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086208 00000100:00100000:3.0:1788748511.058404:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788748511.058415:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:15725:x1875638377086208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748511.058468:0:14310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788748511.058486:0:14310:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788748511.132163:0:14310:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788748511.132301:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788748511.132783:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788748511.132793:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788748511.132823:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.132859:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.132871:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.132925:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.132946:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 19 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748511.132963:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377086336:0@lo:104: 00000100:00100000:2.0:1788748511.133365:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.133474:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec8a0eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748511.133691:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086336 00000100:00100000:1.0:1788748511.133702:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086336 00000100:00100000:1.0:1788748511.134545:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748511.134566:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377086336:12345-0@lo:104: 00010000:00010000:1.0:1788748511.134588:0:14301:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748511.134693:0:14301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748511.134716:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:14334:x1875638377086336:12345-0@lo:104: Request processed in 160us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748511.134725:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788748511.134797:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748511.135280:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748511.135293:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748511.135297:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748511.135307:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748511.135315:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748511.135321:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748511.135364:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748511.135371:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748511.135394:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748511.135402:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d800/0x5b377f42a7a7d0ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0f3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748511.135422:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748511.135423:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748511.135442:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748511.137672:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377086464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748511.137775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748511.138364:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086464 00000100:00100000:2.0:1788748511.138376:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086464 00010000:00010000:2.0:1788748511.139043:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 20 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748511.139161:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748511.139178:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+20:3306:x1875638377086464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748511.139211:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748511.139247:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 20 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139263:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 20 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139297:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139307:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748511.139332:0:14304:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006539831s 00010000:00010000:2.0:1788748511.139338:0:14304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139346:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139354:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139362:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139368:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748511.139373:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139382:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139392:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748511.139426:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748511.139526:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+20:3306:x1875638377086464:12345-0@lo:103:ldlm_bl.0 Request processed in 355us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748511.139534:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788748511.145744:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d0f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d0ec expref: 19 pid: 14310 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748511.145775:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875638377086336:0@lo:104: 00010000:00010000:1.0:1788748511.145810:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748511.145822:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748511.145831:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748511.145839:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3000/0x5b377f42a7a7d219 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748511.147116:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377086464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748511.167482:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:15725:x1875638377086208:12345-0@lo:253:mount.lustre.0 Request processed in 109060us (115153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748511.167497:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748511.167616:0:15725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9f57890-027b-4d36-a4ce-36a41fae69fb:15725:1875638377086208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748511.167640:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788748511.167645:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748511.167647:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748511.167648:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748511.167650:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748511.167651:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748511.167673:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748511.167675:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748511.167677:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748511.167679:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748511.167701:0:15725:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788748511.183009:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748511.183664:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748511.183920:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748511.184113:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788748511.184625:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788748511.186078:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788748511.188697:0:15725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788748511.357537:0:15725:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788748511.357549:0:15725:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788748511.357607:0:15725:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788748511.357682:0:15725:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788748511.357707:0:15725:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788748511.357747:0:15725:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788748511.854475:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748512.302199:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788748512.365119:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788748512.365128:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cefd703800 from 8 10000000:01000000:3.0:1788748512.365142:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788748512.365626:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748512.365640:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748512.365652:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748512.365678:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377086592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748512.365761:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748512.365819:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748512.366523:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086592 00000100:00100000:1.0:1788748512.366533:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086592 00000100:00100000:1.0:1788748512.366609:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788748512.366619:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec50d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377086592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748512.366769:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748512.366786:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7d227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d220 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.366826:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7d227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d220 expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.366837:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7d227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d220 expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.366846:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8800, rc 0) 00000100:00100000:1.0:1788748512.366924:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec50d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377086592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748512.366976:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748512.367180:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377086592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748512.367203:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748512.367212:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748512.367291:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377086720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788748512.367327:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748512.367353:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748512.367467:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086720 00000100:00100000:1.0:1788748512.367473:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086720 00000100:00100000:1.0:1788748512.367506:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788748512.367513:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377086720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788748512.367528:0:14310:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748512.367544:0:14310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748512.367547:0:14310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788748512.367624:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377086720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748512.367631:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788748512.367662:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377086720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748512.367713:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748512.367720:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.367729:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748512.878256:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748513.902255:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748514.931745:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748515.575235:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748515.575266:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377086848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748515.575373:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748515.575479:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086848 00000100:00100000:2.0:1788748515.575489:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086848 00000100:00100000:2.0:1788748515.575562:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748515.575574:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377086848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748515.575636:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748515.575694:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377086848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748515.575713:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788748515.575739:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748515.575788:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377086848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748515.950953:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748516.078591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748516.078599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788748516.078604:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748516.078626:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cec44ca000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748516.078641:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377086976:0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.078655:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730ea00 x1875638377087232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748516.078739:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748516.078751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377087104:0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.078793:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.078824:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377087616:0@lo:400:kworker.0 00000100:00100000:2.0:1788748516.078875:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.078919:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377087360:0@lo:400:kworker.0 00000100:00100000:2.0:1788748516.078953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.078980:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748516.078987:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377087488:0@lo:400:kworker.0 00000100:00100000:2.0:1788748516.079046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.079085:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377086976 00000100:00100000:2.0:1788748516.079093:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377086976 00000100:00100000:2.0:1788748516.079152:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788748516.079162:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377086976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079208:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087616 00000100:00100000:3.0:1788748516.079214:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087616 00000100:00100000:2.0:1788748516.079241:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377086976:12345-0@lo:400:kworker.0 Request processed in 80us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748516.079250:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788748516.079256:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087360 00000100:00100000:3.0:1788748516.079260:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087360 00000100:00100000:3.0:1788748516.079275:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087488 00000100:00100000:3.0:1788748516.079277:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087488 00000100:00100000:2.0:1788748516.079295:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748516.079303:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748516.079307:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377087616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079315:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377087360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748516.079352:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377087616:12345-0@lo:400:kworker.0 Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748516.079360:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748516.079370:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377087360:12345-0@lo:400:kworker.0 Request processed in 56us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748516.079376:0:14320:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748516.079381:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748516.079387:0:14320:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788748516.079401:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788748516.079413:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748516.079457:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079503:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087104 00000100:00100000:3.0:1788748516.079507:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087104 00000100:00100000:3.0:1788748516.079538:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748516.079546:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079587:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377087104:12345-0@lo:400:kworker.0 Request processed in 43us (795us total) trans 0 rc 0/0 00010000:00080000:2.0:1788748516.079595:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730c380 x1875638377087360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748516.079605:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748516.079619:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377087360:0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079637:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377087104:0@lo:400:kworker.0 00010000:00080000:2.0:1788748516.079657:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730f800 x1875638377087616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748516.079681:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377087616:0@lo:400:kworker.0 00000100:00100000:2.0:1788748516.079697:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377086976:0@lo:400:kworker.0 00000100:00100000:3.0:1788748516.079703:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377087488:12345-0@lo:400:kworker.0 Request processed in 292us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748516.079713:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788748516.079749:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730e300 x1875638377087488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748516.079760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788748516.080307:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377087232:0@lo:8:kworker.0 00000100:00100000:1.0:1788748516.080356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748516.080411:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087232 00000100:00100000:1.0:1788748516.080416:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087232 00000100:00100000:1.0:1788748516.080443:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748516.080448:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1875638377087232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788748516.080480:0:15495:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:1.0:1788748516.080522:0:15495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d22e 00002000:00100000:1.0:1788748516.080539:0:15495:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cefd76b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788748516.080544:0:15495:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788748516.080548:0:15495:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748516.081107:0:15495:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748516.081141:0:15495:0:(import.c:65:import_set_state_nolock()) ffff99cefd768000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748516.081212:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638377087232:12345-0@lo:8:kworker.0 Request processed in 761us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748516.081220:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788748516.081271:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730ea00 x1875638377087232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788748516.081284:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788748516.081494:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748516.081501:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788748516.081504:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748516.081935:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748516.081943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377087232:0@lo:8:kworker.0 00000004:00080000:0.0:1788748516.082051:0:14342:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788748516.082932:0:14343:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788748516.082962:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875638377087872:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788748516.083056:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.083099:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1ba4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748516.083121:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748516.083133:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377087744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748516.083160:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748516.083219:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087872 00000100:00100000:2.0:1788748516.083285:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087872 00000100:00100000:2.0:1788748516.083349:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748516.083360:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14343:x1875638377087872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788748516.083384:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377087744 00000100:00100000:1.0:1788748516.083402:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377087744 00000100:00100000:1.0:1788748516.083451:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748516.083460:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377087744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748516.083490:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748516.083553:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875638377087744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748516.083561:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788748516.083626:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cefb632680 x1875638377087744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788748516.083715:0:14342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433126698925ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788748516.083892:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377087744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788748516.089215:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788748516.096854:0:15006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788748516.096873:0:15006:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788748516.096880:0:15006:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788748516.111295:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.111314:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.111336:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.111341:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.111348:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.111380:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.111395:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.111403:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.111449:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748516.112788:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.112800:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.112815:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.112819:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.112825:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.112838:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.112847:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.112856:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.112891:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788748516.112958:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748516.112969:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.112981:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.112987:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113040:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113065:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113074:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33c9c6a/0x5b377f42a7a7d235 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113107:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.113111:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113119:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.113123:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113132:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.113137:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.113146:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113155:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d23c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.113181:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.113183:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.113185:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748516.113830:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.113839:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.113851:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.113858:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.113864:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.113876:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.113886:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.113894:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.113918:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.114108:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.114116:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.114127:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ea00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.114132:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.114141:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.114156:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.114164:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.114182:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.114184:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.114186:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748516.132057:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.132078:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132115:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.132120:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.132129:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132148:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132160:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132169:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132207:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.132225:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.132231:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132239:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.132245:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132256:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132291:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132300:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba2ded9e/0x5b377f42a7a7d24a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.132324:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.132327:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.132329:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748516.133066:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.133075:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133086:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.133090:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.133096:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133107:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133117:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133125:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133158:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.133171:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.133176:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133185:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.133201:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133211:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133224:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133232:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb1cd83/0x5b377f42a7a7d251 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133247:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.133248:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.133250:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748516.133703:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.133711:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133721:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.133731:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.133736:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133747:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133756:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133765:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.133790:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748516.134120:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748516.134130:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134140:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.134145:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134162:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748516.134260:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.134267:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134276:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.134280:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.134285:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134296:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134304:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134317:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134333:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.134343:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.134348:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134355:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.134359:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134367:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134381:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134388:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d25f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134403:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.134405:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.134407:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.134766:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134789:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c282abd7/0x5b377f42a7a7d258 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748516.134800:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.134807:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.134809:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.134812:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.134818:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134829:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.134833:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.134838:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134848:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134856:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134863:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.134885:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748516.134928:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748516.134935:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134944:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.134949:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134958:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134972:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134980:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d266 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.134994:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.134997:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.134999:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748516.142349:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.142371:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142394:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.142399:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.142407:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142426:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142447:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142456:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142476:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.142490:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.142496:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142505:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.142510:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142521:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142539:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142546:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058bf82c4/0x5b377f42a7a7d26d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.142567:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.142574:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.142576:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748516.145271:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.145290:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145309:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788748516.145315:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.145321:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145338:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145350:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145358:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145379:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.145395:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.145402:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145411:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.145416:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145446:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145465:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145474:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091eaa09a/0x5b377f42a7a7d274 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.145491:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.145493:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.145494:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748516.148652:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.148678:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148700:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.148706:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.148714:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148732:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148743:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148750:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148776:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748516.148792:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748516.148798:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148807:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536ea00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.148812:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148836:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148857:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148865:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9f9846/0x5b377f42a7a7d27b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.148884:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.148886:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.148888:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748516.150542:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.150556:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.150574:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.150579:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.150586:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.150730:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.150742:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.150758:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.150787:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748516.151562:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748516.151575:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.151590:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.151596:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.151723:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.151750:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.151768:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aa8c1be/0x5b377f42a7a7d282 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.151793:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.151796:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.151797:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748516.152151:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.152280:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.152301:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.152306:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.152313:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.152325:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.152337:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.152345:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.152471:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748516.152478:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.152486:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fc00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.152490:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.152494:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748516.152498:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.152708:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.152717:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d4f050/0x5b377f42a7a7d289 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.152732:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.152734:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.152735:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788748516.152940:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788748516.155363:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.155506:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.155535:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.155541:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.155549:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.155567:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.155578:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.155586:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.156149:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748516.159794:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.159813:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.159836:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.159842:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.159851:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.159871:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.159897:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.159906:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.159938:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748516.159981:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748516.159995:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160006:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.160050:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160064:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160149:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160239:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a166fbb/0x5b377f42a7a7d290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160265:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748516.160269:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160276:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.160280:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160290:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160315:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160324:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537032fe/0x5b377f42a7a7d297 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.160338:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.160340:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.160342:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.160519:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748516.165530:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.165551:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.165572:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.165578:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.165585:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.165809:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.165823:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.165831:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.166181:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748516.166960:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748516.166969:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.166984:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.166989:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748516.166995:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.167008:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.167056:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.167064:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171128:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748516.171147:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171286:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.171293:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171307:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171334:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171342:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7bebe5/0x5b377f42a7a7d29e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.171532:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748516.171803:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748516.171810:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171819:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536fa00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748516.171822:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171831:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171843:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171851:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097c33f7f/0x5b377f42a7a7d2a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.171866:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.171869:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.171871:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748516.172149:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748516.172152:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748516.172154:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748516.182006:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748516.183162:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.183352:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=433s v=(0 0) 00010000:00010000:0.0:1788748516.183513:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748516.183525:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.183544:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.183558:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.183565:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.183755:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.184075:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.184133:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.184143:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.184147:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.184163:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.184184:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.184211:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad15ee8/0x5b377f42a7a7d2ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.184239:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.184241:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.184243:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748516.187882:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748516.187898:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.187918:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=433s v=(0 0) 00010000:00010000:0.0:1788748516.187923:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748516.187929:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.187946:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.187959:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.187974:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748516.188009:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.188283:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.188294:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.188304:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.188309:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.188319:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.188338:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.188360:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.188362:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.188364:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748516.189141:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df2e96e5/0x5b377f42a7a7d2b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748516.191931:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.191946:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.191967:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.191973:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.191981:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.191998:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.192268:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.192278:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.192303:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.196294:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.196318:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.196354:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.196360:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.196373:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.196402:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.196410:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.196449:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.196451:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.196453:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748516.200549:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.200569:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.200591:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.201514:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.201525:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.201548:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.201562:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.201569:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.201812:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.207500:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.207519:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.207535:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.207540:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748516.207552:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748516.207553:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.207563:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.207586:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.207592:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748516.207595:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.207605:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a16f8c65/0x5b377f42a7a7d2c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.207625:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.207627:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.207629:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748516.208110:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.208127:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.208139:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.208148:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.208506:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.208514:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.208522:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.208531:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.208535:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.208545:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.208561:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.208569:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1da8384/0x5b377f42a7a7d2c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.208599:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.208601:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.208602:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748516.211934:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.211953:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.211974:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.211987:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.211994:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.212031:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.212055:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.212062:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.212089:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.213453:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.213468:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.213483:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.213489:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.213502:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.213528:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.213536:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928edf19/0x5b377f42a7a7d2cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.213565:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.213568:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.213571:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748516.214364:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.214500:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.214517:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.214523:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.214531:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.214546:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.214558:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.214573:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.214798:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.214913:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.214922:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.214943:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.214948:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.214957:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.214974:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.214981:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d2d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.214997:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.214999:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.215001:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748516.216835:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.216850:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.216868:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.216874:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.216880:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.216895:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.216906:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.216914:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.216951:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748516.216970:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748516.216979:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.216990:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748516.216995:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.217004:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.217062:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.217070:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8e366d/0x5b377f42a7a7d2dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748516.217094:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.217098:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748516.217101:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748516.218796:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.218809:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.218834:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.218838:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.218845:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.218859:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.218870:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.218877:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.218907:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788748516.219955:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.219967:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.219981:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1788748516.219985:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.219992:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.220005:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.220111:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.220119:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.220151:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788748516.221283:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748516.221296:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221311:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.221325:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221337:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748516.221342:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748516.221352:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221362:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.221365:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=433s v=(0 0) 00010000:00010000:3.0:1788748516.221374:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d19c167/0x5b377f42a7a7d2e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221399:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748516.221404:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221422:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.221426:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221433:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221444:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221452:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d2eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.221473:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.221475:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.221477:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748516.221497:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748516.221505:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.221519:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.221528:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.221535:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748516.221681:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788748516.221941:0:15006:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788748516.222096:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14343:x1875638377087872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 138733us (139036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748516.222108:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788748516.222797:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748516.222808:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.222820:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748516.222825:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.222835:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.222856:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.222863:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d2f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748516.222884:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.222886:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748516.222888:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748516.223356:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875638377087872:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788748516.223379:0:14343:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788748516.223451:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875638377088000:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788748516.223510:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748516.223736:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccd0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748516.223897:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088000 00000100:00100000:1.0:1788748516.223907:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088000 00010000:00010000:2.0:1788748516.223967:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748516.223986:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748516.223999:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14343:x1875638377088000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788748516.225130:0:15495:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788748516.246404:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14343:x1875638377088000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22394us (22879us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788748516.246422:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748516.249295:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875638377088000:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788748516.249329:0:14343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1788748516.767341:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788748516.767363:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1788748516.976845:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748517.997438:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748518.347568:0:16084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788748519.023774:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748520.055010:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748520.119259:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.119959:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219648 00000100:00100000:1.0:1788748520.119971:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219648 00000100:00100000:1.0:1788748520.120061:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:1.0:1788748520.120069:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2346:x1875638358219648:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788748520.120097:0:14312:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 78d8312a-c6be-424c-9507-3b6e26d87fc6@192.168.203.4@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1788748520.120272:0:14312:0:(genops.c:1384:class_connect()) connect: client 78d8312a-c6be-424c-9507-3b6e26d87fc6, cookie 0x5b377f42a7a7d2f9 00000100:00080000:0.0:1788748520.128534:0:14312:0:(import.c:65:import_set_state_nolock()) ffff99cefb0a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748520.128637:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+5:2346:x1875638358219648:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 8561us (9381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748520.128649:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:3.0:1788748520.139838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748520.140114:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219776 00000100:00100000:2.0:1788748520.140125:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219776 00000100:00100000:2.0:1788748520.140192:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1788748520.140203:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+5:13725:x1875638358219776:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788748520.140221:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748520.140241:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec3c00/0x5b377f42a7a7d300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219f2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748520.140269:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3c00/0x5b377f42a7a7d300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f2 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748520.140281:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec3c00/0x5b377f42a7a7d300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f2 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748520.140302:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3c00, rc 0) 00000100:00100000:2.0:1788748520.140412:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+6:13725:x1875638358219776:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 211us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748520.140419:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:3.0:1788748520.143576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748520.143674:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358219904 00000100:00100000:0.0:1788748520.143684:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358219904 00000100:00100000:0.0:1788748520.143741:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1788748520.143753:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+6:13725:x1875638358219904:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748520.145651:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+6:13725:x1875638358219904:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 1890us (2081us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748520.145677:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1788748520.150007:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.153198:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220032 00000100:00100000:3.0:1788748520.153213:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220032 00000100:00100000:3.0:1788748520.153341:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1788748520.153354:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+6:13725:x1875638358220032:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748520.153370:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748520.153388:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536f200/0x5b377f42a7a7d307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee62265219f9 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.153416:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536f200/0x5b377f42a7a7d307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f9 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.153428:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536f200/0x5b377f42a7a7d307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f9 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.153437:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f200, rc 0) 00000100:00100000:3.0:1788748520.153502:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+7:13725:x1875638358220032:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 151us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.153509:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1788748520.158527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.158631:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220160 00000100:00100000:1.0:1788748520.158651:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220160 00000100:00100000:1.0:1788748520.158709:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1788748520.158719:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+7:13725:x1875638358220160:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788748520.158998:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13725:x1875638358220160:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 279us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.159006:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:0.0:1788748520.162918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.163744:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220288 00000100:00100000:3.0:1788748520.163756:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220288 00000100:00100000:3.0:1788748520.163819:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:3.0:1788748520.163830:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13725:x1875638358220288:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788748520.164178:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13725:x1875638358220288:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 348us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.164193:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:3.0:1788748520.170729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748520.175897:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220416 00000100:00100000:2.0:1788748520.175913:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220416 00000100:00100000:2.0:1788748520.175984:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1788748520.175995:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13744:x1875638358220416:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748520.176358:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13744:x1875638358220416:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 363us (5637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748520.176367:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1788748520.200236:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.200334:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220544 00000100:00100000:1.0:1788748520.200344:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220544 00000100:00100000:1.0:1788748520.200400:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:1.0:1788748520.200410:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13744:x1875638358220544:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748520.200726:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13744:x1875638358220544:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 316us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.200735:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788748520.210319:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.210542:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220672 00000100:00100000:3.0:1788748520.210552:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220672 00000100:00100000:3.0:1788748520.210615:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1788748520.210625:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:13725:x1875638358220672:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748520.210651:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748520.210668:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536ea00/0x5b377f42a7a7d30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a23 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.210697:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536ea00/0x5b377f42a7a7d30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a23 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.210708:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536ea00/0x5b377f42a7a7d30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a23 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.210717:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ea00, rc 0) 00000100:00100000:3.0:1788748520.210773:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+9:13725:x1875638358220672:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 150us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.210781:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1788748520.216422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748520.216563:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220800 00000100:00100000:2.0:1788748520.216574:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220800 00000100:00100000:2.0:1788748520.216631:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:2.0:1788748520.216641:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec6601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+9:13725:x1875638358220800:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788748520.216667:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788748520.216689:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788748520.216693:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788748520.216697:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788748520.216700:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788748520.220245:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec6601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+9:13725:x1875638358220800:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 3595us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.220259:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1788748520.226848:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.226965:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358220928 00000100:00100000:1.0:1788748520.226976:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358220928 00000100:00100000:1.0:1788748520.227094:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:1.0:1788748520.227105:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cecdc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+9:13725:x1875638358220928:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748520.227123:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748520.227140:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a2a expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748520.227179:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748520.227191:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748520.227200:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748520.227286:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cecdc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13725:x1875638358220928:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.227294:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:2.0:1788748520.232824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.232915:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221056 00000100:00100000:3.0:1788748520.232925:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221056 00000100:00100000:3.0:1788748520.232987:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1788748520.233009:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13725:x1875638358221056:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788748520.233404:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13725:x1875638358221056:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 395us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.233412:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:2.0:1788748520.236715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.236807:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221184 00000100:00100000:1.0:1788748520.236817:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221184 00000100:00100000:1.0:1788748520.236869:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1788748520.236894:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13725:x1875638358221184:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788748520.237204:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13725:x1875638358221184:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 311us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.237213:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:2.0:1788748520.240757:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.242125:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221312 00000100:00100000:1.0:1788748520.242138:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221312 00000100:00100000:1.0:1788748520.242207:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1788748520.242217:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13748:x1875638358221312:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748520.242813:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13748:x1875638358221312:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 594us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.242821:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1788748520.257750:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.257894:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221440 00000100:00100000:1.0:1788748520.257904:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221440 00000100:00100000:1.0:1788748520.258002:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788748520.258047:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13748:x1875638358221440:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748520.258311:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13748:x1875638358221440:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 299us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.258320:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:2.0:1788748520.264921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.265277:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221568 00000100:00100000:3.0:1788748520.265287:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221568 00000100:00100000:2.0:1788748520.265639:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748520.265647:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875638358221568:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788748520.265675:0:14318:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 58c964ac-5e91-4166-9f7a-7c26cfcbe23d@192.168.203.4@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1788748520.265723:0:14318:0:(genops.c:1384:class_connect()) connect: client 58c964ac-5e91-4166-9f7a-7c26cfcbe23d, cookie 0x5b377f42a7a7d31c 00000004:00100000:2.0:1788748520.265754:0:14318:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788748520.265759:0:14318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788748520.359100:0:14318:0:(import.c:65:import_set_state_nolock()) ffff99cefb0ab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748520.359189:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2346:x1875638358221568:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 93540us (94276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748520.359200:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748520.361361:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748520.361452:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221696 00000100:00100000:0.0:1788748520.361462:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221696 00000100:00100000:0.0:1788748520.361536:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748520.361547:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:0:x1875638358221696:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788748520.361588:0:14320:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788748520.361720:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748520.361821:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:0:x1875638358221696:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 275us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748520.361829:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748520.366137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.366233:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221824 00000100:00100000:3.0:1788748520.366244:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221824 00000100:00100000:3.0:1788748520.366298:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788748520.366308:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358221824:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748520.366339:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788748520.366413:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358221824:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 106us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.366420:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748520.367880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.367958:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358221952 00000100:00100000:3.0:1788748520.367966:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358221952 00000100:00100000:3.0:1788748520.368046:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788748520.368067:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358221952:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788748520.368143:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358221952:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.368150:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748520.372715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748520.372754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748520.372788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748520.372919:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222080 00000100:00100000:1.0:1788748520.372930:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222080 00000100:00100000:1.0:1788748520.372975:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222208 00000100:00100000:1.0:1788748520.372978:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222208 00000100:00100000:1.0:1788748520.372994:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748520.373002:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875638358222080:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788748520.373069:0:15006:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 58c964ac-5e91-4166-9f7a-7c26cfcbe23d@192.168.203.4@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1788748520.373113:0:15006:0:(genops.c:1384:class_connect()) connect: client 58c964ac-5e91-4166-9f7a-7c26cfcbe23d, cookie 0x5b377f42a7a7d323 00002000:00100000:1.0:1788748520.373124:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58c964ac-5e91-4166-9f7a-7c26cfcbe23d/ffff99cee517e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748520.373146:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748520.373485:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748520.373519:0:15006:0:(import.c:65:import_set_state_nolock()) ffff99cee517c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748520.373592:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2346:x1875638358222080:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 589us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.373600:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748520.373623:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748520.373628:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875638358222208:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788748520.373655:0:15006:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 58c964ac-5e91-4166-9f7a-7c26cfcbe23d@192.168.203.4@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1788748520.373673:0:15006:0:(genops.c:1384:class_connect()) connect: client 58c964ac-5e91-4166-9f7a-7c26cfcbe23d, cookie 0x5b377f42a7a7d32a 00002000:00100000:1.0:1788748520.373679:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58c964ac-5e91-4166-9f7a-7c26cfcbe23d/ffff99cee517d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748520.373694:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748520.373884:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748520.373900:0:15006:0:(import.c:65:import_set_state_nolock()) ffff99cee5178800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748520.373924:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2346:x1875638358222208:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 294us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748520.373930:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748520.374283:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222336 00000100:00100000:3.0:1788748520.374291:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222336 00000100:00100000:3.0:1788748520.374336:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788748520.374345:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358222336:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788748520.394333:0:14321:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19920us 00000004:00200000:3.0:1788748520.420553:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748520.420676:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13725:x1875638358222336:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 46326us (47965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.420688:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748520.632961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748520.633107:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222464 00000100:00100000:3.0:1788748520.633121:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222464 00000100:00100000:3.0:1788748520.633216:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788748520.633228:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:13769:x1875638358222464:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1788748520.633255:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748520.633288:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7d331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a54 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633378:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633396:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633415:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748520.633461:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748520.633464:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748520.633506:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633537:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536ec00/0x5b377f42a7a7d331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a54 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633596:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a54 expref: 7 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748520.633606:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748520.633610:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748520.633614:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fa00, rc 0) 00000100:00100000:3.0:1788748520.633711:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:13769:x1875638358222464:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 485us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748520.633719:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748520.685582:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748520.685612:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377088128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748520.685689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748520.685894:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088128 00000100:00100000:2.0:1788748520.685904:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088128 00000100:00100000:2.0:1788748520.686038:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748520.686049:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377088128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748520.686071:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748520.686139:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377088128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748520.686146:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788748520.686200:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748520.686228:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377088128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748521.071098:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748521.197350:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377088512:0@lo:400:kworker.0 00000100:00100000:2.0:1788748521.197445:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748521.197513:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788748521.197519:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377088384:0@lo:400:kworker.0 00000100:00100000:2.0:1788748521.197543:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748521.197566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377088896:0@lo:400:kworker.0 00000100:00100000:2.0:1788748521.197587:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748521.197632:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088512 00000100:00100000:2.0:1788748521.197640:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088512 00000100:00100000:3.0:1788748521.197787:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088896 00000100:00100000:3.0:1788748521.197792:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088896 00000100:00100000:3.0:1788748521.197827:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748521.197840:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377088896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.197909:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377088896:12345-0@lo:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.197917:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748521.197965:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377088896:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.197989:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377088256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748521.198065:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377088768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198086:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748521.198112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748521.198118:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198140:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748521.198178:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088256 00000100:00100000:3.0:1788748521.198182:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088256 00000100:00100000:3.0:1788748521.198209:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748521.198216:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377088256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198248:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377088256:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.198253:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748521.198279:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088768 00000100:00100000:3.0:1788748521.198283:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088768 00000100:00100000:3.0:1788748521.198305:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088640 00000100:00100000:3.0:1788748521.198308:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088640 00000100:00100000:3.0:1788748521.198320:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748521.198326:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377088768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198356:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377088768:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.198361:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748521.198375:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748521.198380:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198405:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377088640:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.198411:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748521.198441:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198449:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377088256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198467:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377088768:0@lo:400:kworker.0 00000100:00080000:3.0:1788748521.198505:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748521.198509:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748521.198522:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377088384 00000100:00100000:3.0:1788748521.198526:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377088384 00000100:00100000:3.0:1788748521.198549:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748521.198556:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377088512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198589:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377088512:12345-0@lo:400:kworker.0 Request processed in 33us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.198595:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748521.198606:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748521.198611:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377088384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198633:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377088384:12345-0@lo:400:kworker.0 Request processed in 22us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748521.198639:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748521.198663:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748521.198675:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788748521.198698:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377088512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748521.200122:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748521.200136:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377089024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748521.200205:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748521.200563:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089024 00000100:00100000:1.0:1788748521.200572:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089024 00000100:00100000:1.0:1788748521.200624:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748521.200645:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377089024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748521.200666:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748521.200952:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377089024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 251us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748521.200960:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748521.201065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377089024:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788748521.283043:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000001:00100000:3.0:1788748521.770968:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00010000:00010000:2.0:1788748522.093185:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748522.542852:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748522.631444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.631542:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222592 00000100:00100000:3.0:1788748522.631552:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222592 00000100:00080000:0.0:1788748522.631705:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748522.631754:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788748522.631768:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:13821:x1875638358222592:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1788748522.632288:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788748522.632473:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:13821:x1875638358222592:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 708us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.632481:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748522.636162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.636267:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222720 00000100:00100000:1.0:1788748522.636277:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222720 00000100:00100000:1.0:1788748522.636714:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00080000:0.0:1788748522.636824:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748522.636848:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:13821:x1875638358222720:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1788748522.636886:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748522.637241:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:13821:x1875638358222720:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 517us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.637251:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748522.640270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.640523:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222848 00000100:00100000:1.0:1788748522.640534:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222848 00000100:00100000:1.0:1788748522.640855:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748522.640867:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:13821:x1875638358222848:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1788748522.640905:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748522.640994:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:13821:x1875638358222848:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 129us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.641002:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00080000:0.0:1788748522.642479:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748522.883037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.883130:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358222976 00000100:00100000:1.0:1788748522.883140:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358222976 00000100:00100000:1.0:1788748522.883214:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:1.0:1788748522.883224:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:13853:x1875638358222976:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748522.883255:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748522.883274:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d33f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a5b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.883303:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a5b expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.883315:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a5b expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.883324:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9000, rc 0) 00000100:00100000:1.0:1788748522.883382:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358222976:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 159us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.883389:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1788748522.885344:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748522.885497:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223104 00000100:00100000:0.0:1788748522.885506:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223104 00000100:00100000:0.0:1788748522.885556:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1788748522.885566:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358223104:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748522.885889:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358223104:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 323us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748522.885896:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1788748522.888407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.888486:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223232 00000100:00100000:3.0:1788748522.888495:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223232 00000100:00100000:3.0:1788748522.888556:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:3.0:1788748522.888566:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358223232:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788748522.888866:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358223232:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 299us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.888874:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:2.0:1788748522.891395:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.891534:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223360 00000100:00100000:1.0:1788748522.891552:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223360 00000100:00100000:1.0:1788748522.891601:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:1.0:1788748522.891611:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13857:x1875638358223360:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748522.891942:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13857:x1875638358223360:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 331us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.891951:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1788748522.905835:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748522.905917:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223488 00000100:00100000:0.0:1788748522.905925:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223488 00000100:00100000:0.0:1788748522.905979:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:0.0:1788748522.905989:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13857:x1875638358223488:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748522.906321:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13857:x1875638358223488:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 332us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748522.906329:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788748522.921560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.923727:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223616 00000100:00100000:3.0:1788748522.923743:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223616 00000100:00100000:3.0:1788748522.923857:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:3.0:1788748522.923867:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13853:x1875638358223616:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748522.923883:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748522.923900:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536ec00/0x5b377f42a7a7d346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a85 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.923927:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536ec00/0x5b377f42a7a7d346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a85 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.923938:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536ec00/0x5b377f42a7a7d346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a85 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.923947:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536ec00, rc 0) 00000100:00100000:3.0:1788748522.924009:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13853:x1875638358223616:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 143us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.927579:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:2.0:1788748522.938207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.938306:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223744 00000100:00100000:1.0:1788748522.938317:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223744 00000100:00100000:1.0:1788748522.938383:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:1.0:1788748522.938393:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13853:x1875638358223744:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788748522.938418:0:14312:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788748522.938446:0:14312:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788748522.938451:0:14312:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788748522.938454:0:14312:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788748522.938456:0:14312:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788748522.939889:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13853:x1875638358223744:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 1490us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.939901:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1788748522.954430:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.954516:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358223872 00000100:00100000:3.0:1788748522.954526:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358223872 00000100:00100000:3.0:1788748522.954590:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1788748522.954600:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13853:x1875638358223872:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748522.954617:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748522.954643:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521a8c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.954671:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.954683:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.954691:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f400, rc 0) 00000100:00100000:3.0:1788748522.954747:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13853:x1875638358223872:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.954755:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:2.0:1788748522.956960:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.957395:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224000 00000100:00100000:1.0:1788748522.957468:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224000 00000100:00100000:1.0:1788748522.957518:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1788748522.957527:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13853:x1875638358224000:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788748522.958287:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13853:x1875638358224000:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 757us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.958297:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:2.0:1788748522.964290:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.964384:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224128 00000100:00100000:3.0:1788748522.964394:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224128 00000100:00100000:3.0:1788748522.964449:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:3.0:1788748522.964458:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13853:x1875638358224128:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788748522.964971:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13853:x1875638358224128:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 512us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.964988:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:2.0:1788748522.971924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.975576:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224256 00000100:00100000:1.0:1788748522.975808:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224256 00000100:00100000:1.0:1788748522.975872:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:1.0:1788748522.975882:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13862:x1875638358224256:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748522.977109:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13862:x1875638358224256:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 1215us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.977120:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:2.0:1788748522.987612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.987697:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224384 00000100:00100000:3.0:1788748522.987708:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224384 00000100:00100000:3.0:1788748522.987773:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:3.0:1788748522.987784:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13862:x1875638358224384:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748522.988085:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13862:x1875638358224384:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 303us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.988097:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:2.0:1788748522.992924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748522.993156:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224512 00000100:00100000:3.0:1788748522.993282:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224512 00000100:00100000:3.0:1788748522.993377:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748522.993387:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875638358224512:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788748522.993417:0:14318:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from eb271f1b-92e5-4fbb-963b-7b6519557c0b@192.168.203.4@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788748522.993507:0:14318:0:(genops.c:1384:class_connect()) connect: client eb271f1b-92e5-4fbb-963b-7b6519557c0b, cookie 0x5b377f42a7a7d354 00000004:00100000:3.0:1788748522.993703:0:14318:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788748522.993819:0:14318:0:(import.c:65:import_set_state_nolock()) ffff99ced3545000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748522.993891:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2346:x1875638358224512:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 505us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748522.993899:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748522.993994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.994852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.994880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748522.994911:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225152 00000100:00100000:1.0:1788748522.994928:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225152 00000100:00100000:1.0:1788748522.994963:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225024 00000100:00100000:1.0:1788748522.994988:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225024 00000100:00100000:1.0:1788748522.995028:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748522.995036:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358225152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748522.995082:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358225152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.995089:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748522.995103:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748522.995109:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358225024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748522.995132:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358225024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748522.995137:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788748522.995363:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224896 00000100:00100000:0.0:1788748522.995376:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224896 00000100:00100000:0.0:1788748522.995408:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1788748522.995415:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358224896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748522.995445:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358224896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748522.995451:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748523.000204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748523.000311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748523.000639:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224640 00000100:00100000:0.0:1788748523.000649:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224640 00000100:00100000:0.0:1788748523.000716:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358224768 00000100:00100000:0.0:1788748523.000720:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358224768 00000100:00100000:0.0:1788748523.000741:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748523.000750:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+7:0:x1875638358224640:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788748523.000795:0:14320:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788748523.000855:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+7:0:x1875638358224640:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 105us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748523.000869:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748523.000886:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748523.000893:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358224768:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788748523.000904:0:14320:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788748523.000928:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358224768:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 35us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748523.000934:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:3.0:1788748523.000995:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748523.005635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748523.006328:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225280 00000100:00100000:2.0:1788748523.006338:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225280 00000100:00100000:2.0:1788748523.006562:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788748523.006574:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358225280:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788748523.006664:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358225280:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 92us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748523.006671:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748523.013272:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748523.013448:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225664 00000100:00100000:0.0:1788748523.013458:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225664 00000100:00100000:0.0:1788748523.013506:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748523.013517:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358225664:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788748523.013592:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788748523.013676:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13853:x1875638358225664:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 160us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748523.013684:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748523.015770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748523.015924:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225408 00000100:00100000:0.0:1788748523.015932:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225408 00000100:00100000:0.0:1788748523.015970:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748523.015977:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875638358225408:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788748523.016002:0:15007:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from eb271f1b-92e5-4fbb-963b-7b6519557c0b@192.168.203.4@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1788748523.016065:0:15007:0:(genops.c:1384:class_connect()) connect: client eb271f1b-92e5-4fbb-963b-7b6519557c0b, cookie 0x5b377f42a7a7d35b 00002000:00100000:0.0:1788748523.016077:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb271f1b-92e5-4fbb-963b-7b6519557c0b/ffff99cec44c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788748523.016088:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788748523.016336:0:15007:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788748523.016378:0:15007:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ce000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748523.016454:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2346:x1875638358225408:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 475us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748523.016462:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748523.026379:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748523.026723:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225536 00000100:00100000:1.0:1788748523.026734:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225536 00000100:00100000:1.0:1788748523.026781:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788748523.026790:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875638358225536:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788748523.026820:0:15495:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from eb271f1b-92e5-4fbb-963b-7b6519557c0b@192.168.203.4@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1788748523.026848:0:15495:0:(genops.c:1384:class_connect()) connect: client eb271f1b-92e5-4fbb-963b-7b6519557c0b, cookie 0x5b377f42a7a7d362 00002000:00100000:1.0:1788748523.026858:0:15495:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eb271f1b-92e5-4fbb-963b-7b6519557c0b/ffff99cee517f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748523.026868:0:15495:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748523.027116:0:15495:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748523.027155:0:15495:0:(import.c:65:import_set_state_nolock()) ffff99cee517e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748523.027225:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2346:x1875638358225536:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 434us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748523.027234:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00010000:00010000:3.0:1788748523.118651:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748523.217641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748523.217800:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225792 00000100:00100000:2.0:1788748523.217809:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225792 00000100:00100000:2.0:1788748523.217862:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748523.217870:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:13884:x1875638358225792:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1788748523.217888:0:15949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748523.217908:0:15949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ab6 expref: -99 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.217968:0:15949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.217982:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.217996:0:15949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748523.218054:0:15949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748523.218058:0:15949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748523.218079:0:15949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.218122:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 8 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.218150:0:15949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 7 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748523.218159:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748523.218162:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748523.218165:0:15949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748523.218229:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+7:13884:x1875638358225792:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 358us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748523.218236:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:1.0:1788748524.144072:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748525.173855:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748525.345796:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000001:00100000:1.0:1788748525.345951:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000100:00100000:0.0:1788748525.805259:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748525.805327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748525.805419:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089152 00000100:00100000:1.0:1788748525.805428:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089152 00000100:00100000:1.0:1788748525.805488:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748525.805497:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748525.805541:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788748525.805602:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748525.812350:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6846us (7015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748525.812364:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748525.812544:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089152:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788748525.831166:0:16288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788748526.189269:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748526.317196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748526.317221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc60b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748526.317292:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748526.317292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748526.317306:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377089536:0@lo:400:kworker.0 00000100:00100000:1.0:1788748526.317340:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089280 00000100:00100000:3.0:1788748526.317343:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748526.317348:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089280 00000100:00100000:0.0:1788748526.317361:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089664:0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.317383:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377089408:0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.317393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748526.317403:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748526.317412:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748526.317416:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748526.317424:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377089792:0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.317432:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788748526.317445:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748526.317458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748526.317465:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377090048:0@lo:400:kworker.0 00000100:00100000:1.0:1788748526.317496:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748526.317500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748526.317505:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748526.317508:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc60b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748526.317528:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748526.317536:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377089920:0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.317550:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089408 00000100:00100000:0.0:1788748526.317555:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089408 00000100:00100000:3.0:1788748526.317565:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748526.317590:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788748526.317598:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089536 00000100:00100000:0.0:1788748526.317600:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3309:x1875638377089408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.317604:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089536 00000100:00100000:3.0:1788748526.317636:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089664 00000100:00100000:3.0:1788748526.317639:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089664 00000100:00100000:0.0:1788748526.317645:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3309:x1875638377089408:12345-0@lo:400:kworker.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748526.317653:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788748526.317662:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748526.317670:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377089536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.317696:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089792 00000100:00100000:0.0:1788748526.317709:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089792 00000100:00100000:3.0:1788748526.317721:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377089536:12345-0@lo:400:kworker.0 Request processed in 52us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748526.317729:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748526.317740:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090048 00000100:00080000:1.0:1788748526.317742:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748526.317744:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090048 00000100:00100000:3.0:1788748526.317746:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748526.317755:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.317775:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377089920 00000100:00100000:0.0:1788748526.317780:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377089920 00000100:00080000:1.0:1788748526.317783:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748526.317793:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377089664:12345-0@lo:400:kworker.0 Request processed in 40us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748526.317803:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788748526.317852:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748526.317981:0:15949:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788748526.317989:0:15949:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788748526.318031:0:14318:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788748526.318040:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748526.318047:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748526.318079:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377089920:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748526.318092:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748526.318134:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748526.318134:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377089664:0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.318160:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377089920:0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.318170:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377089536:0@lo:400:kworker.0 00000100:00100000:3.0:1788748526.318178:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377089408:0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.319007:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377089792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748526.319087:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377089792:12345-0@lo:400:kworker.0 Request processed in 1276us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748526.319097:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748526.319109:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377089792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748526.319516:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377090048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748526.319819:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875638377090048:12345-0@lo:400:kworker.0 Request processed in 1958us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748526.319826:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748526.320011:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875638377090048:0@lo:400:kworker.0 00000001:00100000:1.0:1788748526.356938:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000001:00100000:3.0:1788748526.939991:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00010000:00010000:1.0:1788748527.213583:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748528.178493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178581:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178604:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178623:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748528.178704:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226048 00000100:00100000:0.0:1788748528.178718:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226048 00000100:00100000:0.0:1788748528.178791:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226432 00000100:00100000:0.0:1788748528.178794:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226432 00000100:00100000:0.0:1788748528.178820:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748528.178832:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2349:x1875638358226048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.178929:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2349:x1875638358226048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 100us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.178938:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748528.178957:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788748528.178974:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2349:x1875638358226432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.179003:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2349:x1875638358226432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.179010:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788748528.179058:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226176 00000100:00100000:0.0:1788748528.179062:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226176 00000100:00100000:0.0:1788748528.179085:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226304 00000100:00100000:0.0:1788748528.179088:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226304 00000100:00100000:0.0:1788748528.179099:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226560 00000100:00100000:0.0:1788748528.179102:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226560 00000100:00100000:0.0:1788748528.179127:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226688 00000100:00100000:0.0:1788748528.179130:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226688 00000100:00100000:0.0:1788748528.179143:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748528.179150:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358226176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.179180:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358226176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.179187:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748528.179199:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788748528.179205:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358226304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.179230:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358226304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.179236:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788748528.179248:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748528.179253:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2350:x1875638358226560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.179276:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2350:x1875638358226560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.179294:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748528.179306:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748528.179312:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2350:x1875638358226688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748528.179338:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2350:x1875638358226688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748528.179343:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:0.0:1788748528.179375:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748528.179379:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748528.179382:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748528.179654:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358225920 00000100:00100000:1.0:1788748528.179660:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358225920 00000100:00100000:1.0:1788748528.179694:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:1.0:1788748528.179702:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2350:x1875638358225920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748528.179738:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2350:x1875638358225920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748528.179745:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00010000:00010000:0.0:1788748528.237201:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748529.265581:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748529.484839:0:16438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe722db010 20000000:00000080:1.0:1788748529.484861:0:16438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdc4d3e800 uarg=0000000000000000 20000000:01000000:1.0:1788748529.484907:0:16438:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788748529.484913:0:16438:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788748529.484919:0:16438:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788748529.495326:0:16439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788748529.495607:0:16438:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788748529.507421:0:16438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788748529.507681:0:16438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507706:0:16438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507715:0:16438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507742:0:16438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507753:0:16438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507760:0:16438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507767:0:16438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507823:0:16438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.507842:0:16438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 12 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.507860:0:16438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090176:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748529.508088:0:16438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.508106:0:16438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 12 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.508116:0:16438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090304:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748529.508154:0:16438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.508173:0:16438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.508183:0:16438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090432:0@lo:104: 00000100:00100000:2.0:1788748529.508237:0:16438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748529.508298:0:16438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.508306:0:16438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 18 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.508313:0:16438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090560:0@lo:104: 00000100:00100000:2.0:1788748529.508334:0:16438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748529.508363:0:16438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748529.508371:0:16438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 18 pid: 14310 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.508379:0:16438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090688:0@lo:104: 00000100:00100000:2.0:1788748529.508405:0:16438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748529.508418:0:16438:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748529.508679:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788748529.508701:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090432 00000100:00100000:3.0:1788748529.508710:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090432 00000100:00100000:3.0:1788748529.508764:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090560 00000100:00100000:3.0:1788748529.508767:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090560 00000100:00100000:3.0:1788748529.508776:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090688 00000100:00100000:3.0:1788748529.508778:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090688 00000100:00100000:3.0:1788748529.508793:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748529.508804:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:16438:x1875638377090432:12345-0@lo:104: 00010000:00010000:3.0:1788748529.508820:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.508898:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748529.508904:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+5:16438:x1875638377090432:12345-0@lo:104: Request processed in 102us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.508910:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748529.508930:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748529.508937:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+4:16438:x1875638377090560:12345-0@lo:104: 00010000:00010000:3.0:1788748529.508945:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.508981:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748529.508986:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+4:16438:x1875638377090560:12345-0@lo:104: Request processed in 51us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.508992:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748529.509005:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748529.509048:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd785050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:16438:x1875638377090688:12345-0@lo:104: 00010000:00010000:3.0:1788748529.509058:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509113:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788748529.509118:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd785050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+3:16438:x1875638377090688:12345-0@lo:104: Request processed in 107us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.509124:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788748529.509168:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748529.509175:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509183:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748529.509188:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509198:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748529.509205:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748529.509212:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748529.509248:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509255:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748529.509277:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509284:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d400/0x5b377f42a7a7d1e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d1ef expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509313:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748529.509316:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509323:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748529.509326:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509334:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748529.509341:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748529.509347:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748529.509361:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509367:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748529.509373:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509380:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d0b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d0bb expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509389:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748529.509392:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509408:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748529.509411:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509418:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748529.509424:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748529.509429:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748529.509442:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509448:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748529.509468:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509475:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7d067 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d06e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.509764:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748529.509766:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748529.509768:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748529.509776:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748529.509783:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748529.509811:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377090816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748529.509855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748529.509896:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748529.509911:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377090944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748529.509935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748529.509967:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377091072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748529.509992:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748529.510071:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090816 00000100:00100000:3.0:1788748529.510077:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090816 00010000:00010000:3.0:1788748529.510116:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 19 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748529.510134:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377090944 00000100:00100000:3.0:1788748529.510138:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377090944 00010000:00010000:3.0:1788748529.510151:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 20 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748529.510160:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091072 00000100:00100000:3.0:1788748529.510163:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091072 00010000:00010000:3.0:1788748529.510174:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 21 pid: 14310 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748529.510188:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748529.510196:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+21:3306:x1875638377090816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748529.510208:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748529.510213:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 21 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510224:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 21 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510244:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748529.510277:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+21:3306:x1875638377090816:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.510291:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748529.510307:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748529.510312:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+20:3306:x1875638377090944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748529.510319:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748529.510324:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 20 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510332:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 20 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510341:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748529.510363:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+20:3306:x1875638377090944:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.510369:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748529.510382:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748529.510388:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef2b70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377091072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748529.510395:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748529.510400:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 19 pid: 14310 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510408:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 19 pid: 14310 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.510416:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748529.510440:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef2b70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377091072:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748529.510445:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788748529.510634:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3a00/0x5b377f42a7a7d1ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d1e8 expref: 18 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.510648:0:16438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdde300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090432:0@lo:104: 00010000:00010000:2.0:1788748529.510661:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147c000/0x5b377f42a7a7d0bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d0b4 expref: 17 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.510685:0:16438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090560:0@lo:104: 00010000:00010000:2.0:1788748529.510698:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f8400/0x5b377f42a7a7d06e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d067 expref: 16 pid: 14310 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748529.510707:0:16438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090688:0@lo:104: 00000100:00100000:2.0:1788748529.510754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377090944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748529.510762:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377090816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748529.510806:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377091072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748529.514762:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748529.514793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748529.514827:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226816 00000100:00100000:0.0:1788748529.514837:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226816 00010000:00010000:0.0:1788748529.514884:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 13 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748529.514913:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358226944 00000100:00100000:0.0:1788748529.514915:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358226944 00010000:00010000:0.0:1788748529.514924:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 14 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748529.514937:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748529.514946:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+14:2347:x1875638358226816:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748529.514962:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748529.514968:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 14 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515001:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 14 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515058:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748529.515125:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc60bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+14:2347:x1875638358226816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748529.515133:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748529.515153:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748529.515159:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2347:x1875638358226944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748529.515167:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748529.515171:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 13 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515179:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 13 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515193:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515202:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515220:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515227:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515235:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515248:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515255:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748529.515260:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515269:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515278:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748529.515288:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748529.515304:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2347:x1875638358226944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748529.515310:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:3.0:1788748529.516619:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536f400/0x5b377f42a7a7d34d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a8c expref: 12 pid: 14313 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748529.516657:0:16438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090176:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748529.516673:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a2a expref: 11 pid: 14312 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748529.516681:0:16438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16438:1875638377090304:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748529.516723:0:16438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.516733:0:16438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.516740:0:16438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748529.516747:0:16438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3200/0x5b377f42a7a7d377 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.285549:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748530.607117:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748530.607128:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec6526800 from 10 10000000:01000000:3.0:1788748530.607136:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748530.607196:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607212:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607226:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748530.607271:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.607363:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.607429:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748530.607458:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091200 00000100:00100000:3.0:1788748530.607466:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091200 00000100:00100000:3.0:1788748530.607527:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788748530.607538:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:14316:x1875638377091200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748530.607556:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748530.607573:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536f600/0x5b377f42a7a7d385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d37e expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607602:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536f600/0x5b377f42a7a7d385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d37e expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607614:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536f600/0x5b377f42a7a7d385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d37e expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607625:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536f600, rc 0) 00000100:00100000:3.0:1788748530.607667:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748530.607674:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788748530.607727:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748530.607743:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.607752:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748530.607823:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.607848:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.607864:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748530.607878:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091328 00000100:00100000:3.0:1788748530.607882:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091328 00000100:00100000:3.0:1788748530.607904:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788748530.607910:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.608262:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748530.608271:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788748530.608308:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.608341:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.608380:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.608395:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748530.608408:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091456 00000100:00100000:3.0:1788748530.608412:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091456 00000100:00100000:3.0:1788748530.608435:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788748530.608442:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.608605:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748530.608613:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788748530.608654:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788748530.610781:0:16474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788748530.610901:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788748530.610926:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748530.610941:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.610955:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748530.610968:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748530.610971:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec31d3800 from 10 10000000:01000000:3.0:1788748530.610975:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748530.611038:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611048:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611060:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748530.611102:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.611180:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.611212:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748530.611238:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091584 00000100:00100000:3.0:1788748530.611246:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091584 00000100:00100000:3.0:1788748530.611295:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788748530.611305:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:14316:x1875638377091584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748530.611321:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748530.611335:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536e200/0x5b377f42a7a7d393 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d38c expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611377:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536e200/0x5b377f42a7a7d393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d38c expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611389:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536e200/0x5b377f42a7a7d393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d38c expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611400:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536e200, rc 0) 00000100:00100000:3.0:1788748530.611446:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748530.611454:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788748530.611512:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748530.611529:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.611539:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748530.611599:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.611626:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.611726:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748530.615323:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091712 00000100:00100000:2.0:1788748530.615345:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091712 00000100:00100000:2.0:1788748530.615419:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788748530.615431:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748530.615999:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 569us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748530.616010:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748530.616350:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.616427:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.616498:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.616539:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748530.616634:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091840 00000100:00100000:3.0:1788748530.616648:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091840 00000100:00100000:3.0:1788748530.616700:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748530.616710:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.616915:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748530.616923:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748530.617134:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788748530.619644:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788748530.620311:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788748530.620348:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748530.620364:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.620380:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748530.620394:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748530.620398:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cefd703800 from 10 10000000:01000000:3.0:1788748530.620402:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748530.620450:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.620459:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748530.620471:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748530.620503:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748530.620587:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748530.620659:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748530.621067:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377091968 00000100:00100000:0.0:1788748530.621088:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377091968 00000100:00100000:0.0:1788748530.621158:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748530.621171:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:14316:x1875638377091968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748530.621190:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748530.621207:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d3a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d39a expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748530.621238:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d39a expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748530.621251:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d39a expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748530.621268:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5a00, rc 0) 00000100:00100000:0.0:1788748530.621326:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377091968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748530.621334:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788748530.621370:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377091968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748530.621393:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748530.621406:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748530.621481:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377092096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748530.621659:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748530.621716:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748530.621770:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092096 00000100:00100000:0.0:1788748530.621775:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092096 00000100:00100000:0.0:1788748530.621809:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788748530.621817:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377092096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748530.622197:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377092096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 379us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748530.622206:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788748530.622302:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377092096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748530.622344:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377092224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748530.622389:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748530.622416:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec3602600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748530.622462:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092224 00000100:00100000:0.0:1788748530.622467:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092224 00000100:00100000:0.0:1788748530.622672:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788748530.622684:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377092224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748530.622907:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:14316:x1875638377092224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748530.622916:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748530.622999:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9f57890-027b-4d36-a4ce-36a41fae69fb:14316:1875638377092224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788748530.623819:0:16477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788748530.623890:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788748530.623916:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748530.623934:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748530.623947:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748530.928196:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748530.928227:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377092352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748530.928319:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748530.928409:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092352 00000100:00100000:0.0:1788748530.928418:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092352 00000100:00100000:0.0:1788748530.928487:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748530.928498:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377092352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748530.928566:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748530.928620:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377092352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748530.928627:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788748530.928652:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748530.928698:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377092352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748531.302560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748531.304105:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227072 00000100:00100000:3.0:1788748531.304118:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227072 00000100:00100000:3.0:1788748531.304176:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:3.0:1788748531.304186:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:13739:x1875638358227072:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748531.304205:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748531.304224:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d3a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521abd expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748531.304258:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d3a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521abd expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748531.304270:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d3a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521abd expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748531.304279:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fc00, rc 0) 00000100:00100000:3.0:1788748531.304347:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227072:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748531.304355:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00010000:00010000:3.0:1788748531.311676:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748531.312699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748531.312801:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227200 00000100:00100000:2.0:1788748531.312827:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227200 00000100:00100000:2.0:1788748531.312887:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:2.0:1788748531.312900:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227200:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748531.313239:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227200:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 341us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.313248:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1788748531.318450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748531.318589:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227328 00000100:00100000:2.0:1788748531.318606:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227328 00000100:00100000:2.0:1788748531.318680:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788748531.318697:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227328:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748531.319011:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227328:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 320us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.319047:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1788748531.330953:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748531.331365:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227456 00000100:00100000:2.0:1788748531.331381:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227456 00000100:00100000:2.0:1788748531.331453:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1788748531.331464:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:13739:x1875638358227456:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748531.331494:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748531.331535:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7d3af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ac4 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748531.331580:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7d3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ac4 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748531.331594:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7d3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ac4 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748531.331605:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2400, rc 0) 00000100:00100000:2.0:1788748531.331879:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13739:x1875638358227456:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 416us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.331888:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:0.0:1788748531.335255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748531.335813:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227584 00000100:00100000:2.0:1788748531.335826:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227584 00000100:00100000:2.0:1788748531.335900:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788748531.335912:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13739:x1875638358227584:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748531.337806:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13739:x1875638358227584:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 1882us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.337822:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1788748531.342914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748531.343697:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227712 00000100:00100000:3.0:1788748531.343714:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227712 00000100:00100000:3.0:1788748531.343791:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788748531.343802:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13739:x1875638358227712:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748531.347902:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:13739:x1875638358227712:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 4085us (4986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748531.347920:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788748531.438920:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748531.438966:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377092480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748531.439111:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748531.439208:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092480 00000100:00100000:3.0:1788748531.439219:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092480 00000100:00100000:3.0:1788748531.439290:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748531.439301:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377092480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748531.439349:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748531.439405:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377092480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748531.439413:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788748531.439435:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748531.439479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377092480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748531.440551:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748531.440573:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377092992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748531.440581:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377092736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748531.440627:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748531.448317:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377092608:0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448359:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748531.448432:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377092864:0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748531.448542:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092992 00000100:00100000:2.0:1788748531.448553:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092992 00000100:00100000:2.0:1788748531.448617:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092864 00000100:00100000:2.0:1788748531.448621:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092864 00000100:00100000:2.0:1788748531.448643:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748531.448653:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448722:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377092992:12345-0@lo:400:kworker.0 Request processed in 71us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.448730:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748531.448749:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748531.448755:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377092864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448785:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377092864:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.448791:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748531.448811:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092608 00000100:00100000:2.0:1788748531.448815:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092608 00000100:00100000:2.0:1788748531.448844:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788748531.448851:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377092608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.448883:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377092608:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748531.448889:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788748531.448932:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748531.449315:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377092864:0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.449359:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377092992:0@lo:400:kworker.0 00000100:00100000:2.0:1788748531.449368:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377092608:0@lo:400:kworker.0 00000100:00100000:3.0:1788748531.453196:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748531.453487:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377092736 00000100:00100000:0.0:1788748531.453501:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377092736 00000100:00100000:0.0:1788748531.453574:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748531.453585:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377092736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748531.453829:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377092736:12345-0@lo:400:kworker.0 Request processed in 245us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748531.453838:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748531.456375:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377092736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748531.457393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748531.457552:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377093120 00000100:00100000:3.0:1788748531.457563:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377093120 00000100:00100000:3.0:1788748531.457776:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748531.457789:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377093120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748531.457864:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377093120:12345-0@lo:400:kworker.0 Request processed in 77us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748531.457872:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788748531.459263:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748531.459336:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377093120:0@lo:400:kworker.0 00010000:00010000:3.0:1788748532.333775:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748532.781979:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748532.987569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748532.987855:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358227840 00000100:00100000:2.0:1788748532.987888:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358227840 00000100:00100000:2.0:1788748532.987995:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748532.988010:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:14393:x1875638358227840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748532.988069:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748532.988105:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d3b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521acb expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.988187:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.988205:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.988219:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.988237:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.988257:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992178:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992636:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992654:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992662:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748532.992711:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748532.992715:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748532.992764:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992778:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992785:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992792:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992800:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748532.992804:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992814:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992829:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748532.992833:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748532.992839:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992846:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d3bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992861:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992876:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992882:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992887:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748532.992891:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992897:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992905:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cec6646e00) 00010000:00010000:2.0:1788748532.992907:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748532.992910:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992917:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d3c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992971:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d3b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521acb expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992988:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521acb expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748532.992996:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec6646b00) 00010000:00010000:2.0:1788748532.992999:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748532.993007:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3200, rc 0) 00000100:00100000:2.0:1788748532.993160:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:14393:x1875638358227840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 5153us (5612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748532.993170:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:1.0:1788748532.993774:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748533.001141:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.001264:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228096 00000100:00100000:2.0:1788748533.001279:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228096 00000100:00100000:2.0:1788748533.001360:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748533.001373:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:14393:x1875638358228096:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748533.001401:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.001428:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d3d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ad2 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001536:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001562:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001577:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001595:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001603:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.001611:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002057:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7d3e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002087:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7d3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002096:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7d3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748533.002109:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788748533.002364:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002373:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002381:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002387:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.002391:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002400:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002415:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec6646b00) 00010000:00010000:2.0:1788748533.002419:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.002426:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002433:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d3d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002448:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002462:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002469:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002474:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.002476:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002483:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002491:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cec6646800) 00010000:00010000:2.0:1788748533.002494:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.002497:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.002503:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.003183:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d3d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ad2 expref: 10 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.003207:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7d3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ad2 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.003215:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:2.0:1788748533.003218:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.003227:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:2.0:1788748533.003320:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14393:x1875638358228096:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1949us (2194us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788748533.003331:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788748533.012206:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.012526:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228224 00000100:00100000:3.0:1788748533.012539:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228224 00000100:00100000:3.0:1788748533.012633:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788748533.012643:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14393:x1875638358228224:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788748533.012761:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14393:x1875638358228224:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 121us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.012769:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788748533.039559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.039675:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228352 00000100:00100000:2.0:1788748533.039689:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228352 00000100:00100000:2.0:1788748533.039770:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788748533.039781:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14399:x1875638358228352:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748533.039808:0:15949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.039834:0:15949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d3f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ad9 expref: -99 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039914:0:15949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039930:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039943:0:15949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039959:0:15949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039965:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.039972:0:15949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040317:0:15949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040335:0:15949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040343:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040350:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.040354:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040363:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040378:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748533.040381:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.040386:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040392:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d3fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040407:0:15949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040413:0:15949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040420:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040425:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.040435:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040442:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040450:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cec6646800) 00010000:00010000:2.0:1788748533.040453:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.040456:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040461:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040500:0:15949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d3f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ad9 expref: 10 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040510:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748533.040512:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.040515:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d3f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ad9 expref: 10 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.040525:0:15949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2c00, rc 0) 00000100:00100000:2.0:1788748533.040602:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14399:x1875638358228352:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 822us (1057us total) trans 0 rc 301/301 00000100:00100000:2.0:1788748533.040611:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748533.055934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.056145:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228480 00000100:00100000:2.0:1788748533.056167:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228480 00000100:00100000:2.0:1788748533.056226:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748533.056237:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14399:x1875638358228480:12345-192.168.203.4@tcp:700:lfs.0 00000100:00100000:2.0:1788748533.056384:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14399:x1875638358228480:12345-192.168.203.4@tcp:700:lfs.0 Request processed in 147us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748533.056393:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788748533.062944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.063569:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228736 00000100:00100000:3.0:1788748533.063585:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228736 00000100:00100000:3.0:1788748533.063745:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788748533.063759:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14399:x1875638358228736:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1788748533.063838:0:16300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748533.063942:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a54 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.063968:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.063974:0:16300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748533.066605:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.066642:0:16300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 5 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.066651:0:16300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.066711:0:16300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 5 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.066734:0:16300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 5 pid: 15949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748533.066765:0:16300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093248:192.168.203.4@tcp:104: 00000100:00100000:3.0:1788748533.067230:0:16300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7464900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748533.072011:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.072345:0:16300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093248:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748533.072384:0:16300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748533.077661:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228864 00000100:00100000:0.0:1788748533.077686:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228864 00010000:00010000:0.0:1788748533.077784:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 6 pid: 15949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748533.077851:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748533.077863:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2347:x1875638358228864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748533.077911:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748533.077920:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 6 pid: 15949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.077937:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 6 pid: 15949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.077969:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ab6 expref: 6 pid: 15949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.077991:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:0.0:1788748533.077998:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.078009:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.078051:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.078108:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748533.078186:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2347:x1875638358228864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 326us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.078195:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00010000:00010000:3.0:1788748533.078410:0:16300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.078420:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.078451:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.078464:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.078483:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.080050:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788748533.080071:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080093:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080102:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080119:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.080125:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080134:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080153:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.080156:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.080162:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.080169:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d40a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748533.080194:0:16300:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ee4b27e0 reply state 00000000ddb3d4a6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748533.080204:0:16300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748533.080315:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+10:14399:x1875638358228736:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16554us (17382us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788748533.080325:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00080000:1.0:1788748533.081104:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788748533.084918:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.084940:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.084949:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.084977:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.084982:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.084991:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.085011:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ced1a56000) 00010000:00010000:3.0:1788748533.085043:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.085049:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.085057:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d411 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748533.195398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.197347:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358228992 00000100:00100000:2.0:1788748533.197369:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358228992 00000100:00100000:2.0:1788748533.197479:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748533.197492:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:14407:x1875638358228992:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:2.0:1788748533.199331:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.199378:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ae0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199470:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199487:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199502:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748533.199552:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748533.199556:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748533.199607:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199641:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae0 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199673:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae0 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.199703:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:2.0:1788748533.199706:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748533.199711:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2600, rc 0) 00000100:00100000:2.0:1788748533.199821:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+10:14407:x1875638358228992:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 2329us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748533.199830:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748533.236167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.236411:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358229120 00000100:00100000:2.0:1788748533.236426:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358229120 00000100:00100000:2.0:1788748533.236512:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788748533.236525:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:14408:x1875638358229120:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748533.236562:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.236589:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ae7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236664:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236681:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236696:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748533.236750:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788748533.236754:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748533.236811:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236856:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae7 expref: 7 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236880:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae7 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.236889:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:2.0:1788748533.236892:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748533.236896:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3600, rc 0) 00000100:00100000:2.0:1788748533.236979:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:14408:x1875638358229120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 458us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748533.236987:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748533.245395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.245487:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358229248 00000100:00100000:3.0:1788748533.245500:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358229248 00000100:00100000:3.0:1788748533.245761:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788748533.245775:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:14408:x1875638358229248:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748533.245803:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.245828:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521aee expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.245995:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246039:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246096:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246115:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246123:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246130:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246252:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246260:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246267:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.246307:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748533.246312:0:16300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748533.246333:0:16300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246348:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246355:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246373:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246380:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.246385:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246395:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246409:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748533.246412:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.246418:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246426:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147c000/0x5b377f42a7a7d43b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246443:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246450:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246456:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246461:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.246464:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246480:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246489:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ced1a56000) 00010000:00010000:3.0:1788748533.246491:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.246495:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246501:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d800/0x5b377f42a7a7d442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246541:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec147d400/0x5b377f42a7a7d434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521aee expref: 8 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246571:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521aee expref: 7 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.246579:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.246581:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748533.246583:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cee536fa00, rc 0) 00000100:00100000:3.0:1788748533.246681:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+7:14408:x1875638358229248:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 909us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.246689:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748533.258807:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.258988:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358229504 00000100:00100000:0.0:1788748533.259001:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358229504 00000100:00100000:0.0:1788748533.259115:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788748533.259127:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+7:14408:x1875638358229504:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748533.259169:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748533.259196:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521af5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748533.259327:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788748533.259496:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d450 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521af5 expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.259513:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:0.0:1788748533.259517:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748533.259523:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521af5 expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.259539:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748533.259857:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+8:14408:x1875638358229504:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 730us (1061us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788748533.259865:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1788748533.265278:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.265441:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358229760 00000100:00100000:3.0:1788748533.265455:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358229760 00000100:00100000:3.0:1788748533.265523:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1788748533.265534:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+8:14408:x1875638358229760:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1788748533.265610:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748533.266427:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cee536fa00/0x5b377f42a7a7d449 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521aee expref: 8 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.266454:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.266469:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748533.266510:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.266526:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.266538:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748533.267482:0:14320:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b2dbd0bb reply state 00000000e00cfc33 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748533.267500:0:14320:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788748533.267513:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748533.267629:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+9:14408:x1875638358229760:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 2095us (2360us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788748533.267639:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788748533.275193:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.275314:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230016 00000100:00100000:0.0:1788748533.275328:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230016 00000100:00100000:0.0:1788748533.275408:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1788748533.275419:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+9:14408:x1875638358230016:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748533.275739:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+10:14408:x1875638358230016:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 319us (559us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788748533.275748:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00010000:00010000:2.0:1788748533.278943:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.278967:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.278975:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.278982:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.278986:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.278994:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.279039:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56a00) 00010000:00010000:2.0:1788748533.279061:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788748533.279068:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.279084:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42a00/0x5b377f42a7a7d45e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748533.279429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.279533:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230272 00000100:00100000:3.0:1788748533.279611:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230272 00000100:00100000:3.0:1788748533.279774:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788748533.279787:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+9:14408:x1875638358230272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748533.279818:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.279839:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521afc expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.279953:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.279968:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.279979:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.279993:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280001:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280008:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.280301:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788748533.280418:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280426:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280433:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280440:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.280444:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280465:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280478:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748533.280482:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.280486:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280493:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d46c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280507:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280512:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280518:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280524:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.280527:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280534:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280541:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ced1a56000) 00010000:00010000:3.0:1788748533.280544:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.280558:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280579:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280632:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d465 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521afc expref: 11 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.280642:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748533.280644:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748533.280648:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521afc expref: 11 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.281345:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42600, rc 0) 00000100:00100000:2.0:1788748533.281683:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+10:14408:x1875638358230272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1891us (2251us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788748533.281694:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788748533.286447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748533.286647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748533.286799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748533.286875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.287146:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230528 00000100:00100000:0.0:1788748533.287170:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230528 00000100:00100000:0.0:1788748533.287253:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230784 00000100:00100000:0.0:1788748533.287264:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230784 00000100:00100000:0.0:1788748533.287304:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788748533.287316:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358230528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748533.287413:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358230528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 98us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.287421:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788748533.287441:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788748533.287448:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2349:x1875638358230784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748533.287485:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2349:x1875638358230784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.287491:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748533.288026:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230400 00000100:00100000:2.0:1788748533.288033:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230400 00000100:00100000:2.0:1788748533.288090:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1788748533.288099:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2349:x1875638358230400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748533.288138:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2349:x1875638358230400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748533.288145:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00080000:0.0:1788748533.288487:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748533.288784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748533.288810:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230656 00000100:00100000:1.0:1788748533.288816:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230656 00000100:00100000:1.0:1788748533.288856:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358230912 00000100:00100000:1.0:1788748533.288859:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358230912 00000100:00100000:1.0:1788748533.288890:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788748533.288898:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358230656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748533.288938:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358230656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748533.288944:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1788748533.288960:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788748533.288967:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2349:x1875638358230912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748533.288990:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2349:x1875638358230912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748533.288996:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00080000:1.0:1788748533.289034:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748533.291192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.291289:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231040 00000100:00100000:3.0:1788748533.291301:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231040 00000100:00100000:3.0:1788748533.291411:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788748533.291423:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+10:14408:x1875638358231040:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748533.291454:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.291492:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d481 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b03 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.291811:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.291829:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.291843:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.291959:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748533.291964:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748533.291986:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.292048:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d481 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.292070:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.292090:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.292093:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748533.292097:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43e00, rc 0) 00000100:00100000:3.0:1788748533.292224:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+11:14408:x1875638358231040:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 803us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.292232:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788748533.301413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.301648:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231168 00000100:00100000:0.0:1788748533.301728:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231168 00000100:00100000:0.0:1788748533.301841:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788748533.301855:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+11:14408:x1875638358231168:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:0.0:1788748533.312218:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+11:14408:x1875638358231168:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 10004us (10458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.312237:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788748533.317346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748533.317548:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231424 00000100:00100000:1.0:1788748533.317572:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231424 00000100:00100000:1.0:1788748533.317647:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748533.317658:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+11:14408:x1875638358231424:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748533.318718:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+12:14408:x1875638358231424:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1051us (1376us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788748533.318734:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00010000:00010000:3.0:1788748533.359069:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748533.376182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.376661:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231552 00000100:00100000:3.0:1788748533.376674:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231552 00000100:00100000:3.0:1788748533.376810:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1788748533.376823:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+10:14415:x1875638358231552:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748533.376854:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.376894:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b0a expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377003:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377070:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377096:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377114:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377122:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377130:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377308:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377318:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377326:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.377362:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748533.377367:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748533.377417:0:14320:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377443:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377449:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377457:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377463:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.377541:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377624:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377640:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748533.377643:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.377649:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377656:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377673:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377679:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377685:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377697:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.377701:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377707:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377715:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ced1a56000) 00010000:00010000:3.0:1788748533.377717:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.377720:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377726:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d49d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377768:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b0a expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377783:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b0a expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.377791:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.377793:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788748533.377796:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42000, rc 0) 00000100:00100000:3.0:1788748533.377884:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+11:14415:x1875638358231552:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1063us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.377892:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748533.381608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.381742:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231808 00000100:00100000:2.0:1788748533.381756:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231808 00000100:00100000:2.0:1788748533.381877:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788748533.381891:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+11:14415:x1875638358231808:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1788748533.381918:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.381944:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d4ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b11 expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.382145:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.382177:0:16300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.382204:0:16300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.382250:0:16300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.382268:0:16300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 11 pid: 14319 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748533.382284:0:16300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093376:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748533.382448:0:16300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748533.386350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.386876:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358231936 00000100:00100000:3.0:1788748533.386909:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358231936 00010000:00010000:3.0:1788748533.386965:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 12 pid: 14319 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748533.387051:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748533.387063:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+12:2347:x1875638358231936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748533.387091:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748533.387099:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 12 pid: 14319 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.387116:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 12 pid: 14319 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.387146:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748533.387153:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.387177:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.387186:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.387210:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748533.387274:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+12:2347:x1875638358231936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 214us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.387282:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00010000:00010000:2.0:1788748533.389039:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43e00/0x5b377f42a7a7d488 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b03 expref: 11 pid: 14319 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748533.389083:0:16300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093376:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748533.389117:0:16300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.389128:0:16300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.389134:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.389183:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.389196:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.389227:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391697:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391724:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391739:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748533.391755:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748533.391792:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391800:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391808:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391815:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748533.391820:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391829:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391844:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748533.391847:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748533.391940:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.391948:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748533.391967:0:16300:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006ad47526 reply state 000000008ebb955e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748533.391977:0:16300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788748533.392211:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d4ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 14 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.392230:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 13 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.392238:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748533.392240:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788748533.392243:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2a00, rc 0) 00000100:00100000:2.0:1788748533.392450:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14415:x1875638358231808:12345-192.168.203.4@tcp:101:bash.0 Request processed in 10562us (10913us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788748533.392461:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:3.0:1788748533.399118:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399164:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399173:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399181:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748533.399187:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399195:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399216:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99cec6646e00) 00010000:00010000:3.0:1788748533.399220:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748533.399227:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.399234:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d4b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748533.404488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.404898:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358232064 00000100:00100000:3.0:1788748533.404912:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358232064 00000100:00100000:3.0:1788748533.404990:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1788748533.405003:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+13:14415:x1875638358232064:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788748533.405061:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.405100:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d4ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b18 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405217:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405235:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405249:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.405305:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788748533.405310:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748533.405333:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405345:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405374:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d4ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 15 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405394:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 14 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.405404:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:3.0:1788748533.405407:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748533.405411:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43200, rc 0) 00000100:00100000:3.0:1788748533.405496:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14415:x1875638358232064:12345-192.168.203.4@tcp:101:bash.0 Request processed in 496us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748533.405504:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788748533.409533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.409684:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358232320 00000100:00100000:0.0:1788748533.409698:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358232320 00000100:00100000:0.0:1788748533.409785:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748533.409816:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14415:x1875638358232320:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1788748533.410344:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:14415:x1875638358232320:12345-192.168.203.4@tcp:35:bash.0 Request processed in 527us (821us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788748533.410353:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748533.509482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748533.509669:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358232576 00000100:00100000:3.0:1788748533.509683:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358232576 00000100:00100000:3.0:1788748533.509760:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1788748533.509772:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:14425:x1875638358232576:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748533.509805:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748533.509831:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b1f expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748533.509957:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788748533.510186:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d4dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b1f expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.510201:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748533.510204:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748533.510209:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b1f expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748533.510225:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42800, rc 0) 00000100:00100000:3.0:1788748533.510290:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+16:14425:x1875638358232576:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 521us (833us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788748533.510297:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788748533.514999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.515727:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358232832 00000100:00100000:0.0:1788748533.515742:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358232832 00000100:00100000:0.0:1788748533.515880:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788748533.515893:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+16:14425:x1875638358232832:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1788748533.516454:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+17:14425:x1875638358232832:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 561us (1465us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788748533.516462:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748533.611304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.616575:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233088 00000100:00100000:2.0:1788748533.616600:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233088 00000100:00100000:2.0:1788748533.616714:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1788748533.616728:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+17:14428:x1875638358233088:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748533.616763:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748533.616793:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d4ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b26 expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.617175:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.617194:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.617210:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748533.617225:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748533.617404:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d4ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b26 expref: 20 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.617428:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b26 expref: 19 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.617439:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748533.617442:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748533.617446:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3a00, rc 0) 00000100:00100000:2.0:1788748533.617810:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:14428:x1875638358233088:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1083us (6520us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788748533.617819:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788748533.628834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.629102:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233216 00000100:00100000:0.0:1788748533.629112:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233216 00000100:00100000:0.0:1788748533.629276:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1788748533.629286:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:14428:x1875638358233216:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1788748533.629354:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629372:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629386:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629412:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629419:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629442:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629448:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748533.629452:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629460:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629472:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748533.629475:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748533.629480:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.629487:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d4ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748533.629582:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:14428:x1875638358233216:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 297us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.629589:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1788748533.632828:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.632893:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233344 00000100:00100000:0.0:1788748533.632901:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233344 00000100:00100000:0.0:1788748533.633009:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748533.633039:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:2347:x1875638358233344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748533.633054:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748533.633091:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d4f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b26 expref: 19 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.633129:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748533.633134:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748533.633196:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:2347:x1875638358233344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 160us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748533.633204:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788748533.633843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.634006:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233600 00000100:00100000:2.0:1788748533.634175:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233600 00000100:00100000:2.0:1788748533.634248:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748533.634257:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:14428:x1875638358233600:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788748533.634479:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:14428:x1875638358233600:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 222us (636us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788748533.634494:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000040:00080000:3.0:1788748533.805740:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788748533.943617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.943720:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233856 00000100:00100000:0.0:1788748533.943730:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233856 00000100:00100000:0.0:1788748533.943799:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748533.943808:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+19:14459:x1875638358233856:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748533.943833:0:15949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748533.943853:0:15949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d506 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b2d expref: -99 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.944135:0:15949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d50d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.944150:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d50d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.944162:0:15949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d50d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748533.944174:0:15949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748533.944321:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d506 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b2d expref: 22 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.944340:0:15949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d50d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b2d expref: 21 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748533.944361:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748533.944365:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748533.944369:0:15949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748533.944507:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:14459:x1875638358233856:12345-192.168.203.4@tcp:101:cat.0 Request processed in 699us (899us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788748533.944514:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788748533.949822:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748533.950279:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358233984 00000100:00100000:2.0:1788748533.950289:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358233984 00000100:00100000:2.0:1788748533.950361:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788748533.950381:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:2347:x1875638358233984:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748533.950398:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748533.950424:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d50d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b2d expref: 21 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748533.950443:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748533.950448:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748533.950505:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+20:2347:x1875638358233984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 134us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748533.950511:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788748533.952131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748533.952208:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358234240 00000100:00100000:0.0:1788748533.952217:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358234240 00000100:00100000:0.0:1788748533.952259:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748533.952268:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+20:14459:x1875638358234240:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1788748533.952609:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:14459:x1875638358234240:12345-192.168.203.4@tcp:35:cat.0 Request processed in 340us (482us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788748533.952616:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748534.025208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.025310:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358234496 00000100:00100000:2.0:1788748534.025321:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358234496 00000100:00100000:2.0:1788748534.025396:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788748534.025407:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:14465:x1875638358234496:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788748534.025433:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748534.025453:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d51b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b34 expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025566:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025583:0:16300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025606:0:16300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 22 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025615:0:16300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025652:0:16300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 22 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025666:0:16300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 22 pid: 14319 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748534.025680:0:16300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093504:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748534.025797:0:16300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.025807:0:16300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748534.025816:0:16300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093632:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748534.025840:0:16300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed615540 going to sleep for 11 seconds 00000100:00080000:1.0:1788748534.026364:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748534.028100:0:16300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093504:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748534.028116:0:16300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16300:1875638377093632:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748534.028145:0:16300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748534.028621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.028706:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358234624 00000100:00100000:0.0:1788748534.028715:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358234624 00010000:00010000:0.0:1788748534.028754:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 23 pid: 14319 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748534.028806:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748534.028817:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef2b71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:2347:x1875638358234624:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748534.028834:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748534.028841:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 23 pid: 14319 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.028853:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 23 pid: 14319 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.028888:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43200/0x5b377f42a7a7d4d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b18 expref: 23 pid: 14319 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.028905:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748534.028910:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.028919:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.028926:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748534.028984:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef2b71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+22:2347:x1875638358234624:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 169us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748534.028992:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1788748534.030522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.030674:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358234752 00000100:00100000:3.0:1788748534.030686:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358234752 00010000:00010000:3.0:1788748534.030739:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748534.030868:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788748534.030897:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+22:2349:x1875638358234752:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748534.030916:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748534.030925:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.030941:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.030969:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d4c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b11 expref: 22 pid: 16300 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.030990:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:3.0:1788748534.030996:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.031007:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.031064:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.031114:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748534.031176:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:2349:x1875638358234752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 281us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748534.031184:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00010000:00010000:2.0:1788748534.031249:0:16300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.031266:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748534.031289:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748534.031479:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d51b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b34 expref: 22 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.031502:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b34 expref: 21 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.031510:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748534.031512:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748534.031515:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3e00, rc 0) 00000100:00100000:2.0:1788748534.035096:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:14465:x1875638358234496:12345-192.168.203.4@tcp:101:dd.0 Request processed in 9680us (9888us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788748534.035109:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788748534.047743:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.047961:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235008 00000100:00100000:2.0:1788748534.047973:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235008 00000100:00100000:2.0:1788748534.048061:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1788748534.048083:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+21:14465:x1875638358235008:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1788748534.048345:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.048363:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.048388:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748534.048445:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788748534.048494:0:14318:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000079effefc reply state 0000000010e50a25 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748534.048504:0:14318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748534.048595:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14465:x1875638358235008:12345-192.168.203.4@tcp:36:dd.0 Request processed in 524us (861us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788748534.048603:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000020:00080000:2.0:1788748534.048608:0:14318:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788748534.050541:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050562:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050570:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050576:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.050581:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050587:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050601:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748534.050604:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.050621:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.050627:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d530 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748534.054335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.054433:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235136 00000100:00100000:0.0:1788748534.054443:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235136 00000100:00100000:0.0:1788748534.054513:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1788748534.054524:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:14465:x1875638358235136:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1788748534.054554:0:15949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748534.054578:0:15949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d537 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b3b expref: -99 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.054641:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d537 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b3b expref: 24 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.054657:0:15949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d537 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b3b expref: 24 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.054700:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748534.054704:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748534.054708:0:15949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748534.054772:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14465:x1875638358235136:12345-192.168.203.4@tcp:101:dd.0 Request processed in 250us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748534.054780:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1788748534.076010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.076151:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235392 00000100:00100000:2.0:1788748534.076162:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235392 00000100:00100000:2.0:1788748534.076228:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788748534.076238:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14465:x1875638358235392:12345-192.168.203.4@tcp:103:dd.0 00010000:00010000:2.0:1788748534.076253:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748534.076278:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7d537 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b3b expref: 24 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.076297:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748534.076303:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748534.076357:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:14465:x1875638358235392:12345-192.168.203.4@tcp:103:dd.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.076365:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788748534.079365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.079456:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235520 00000100:00100000:2.0:1788748534.079476:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235520 00000100:00100000:2.0:1788748534.079586:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788748534.079596:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:14465:x1875638358235520:12345-192.168.203.4@tcp:58:dd.0 00010000:00010000:2.0:1788748534.079689:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.079707:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.079720:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748534.080547:0:16300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748534.080697:0:16300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788748534.080764:0:16300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788748534.080873:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:14465:x1875638358235520:12345-192.168.203.4@tcp:58:dd.0 Request processed in 1275us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.080883:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1788748534.090056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.090147:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235648 00000100:00100000:3.0:1788748534.090157:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235648 00000100:00100000:3.0:1788748534.090212:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1788748534.090223:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+23:14465:x1875638358235648:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1788748534.090252:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748534.090274:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b42 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090333:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090344:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 24 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090364:0:14319:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090376:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 24 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090390:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:3.0:1788748534.090393:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748534.090396:0:14319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 24 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.090403:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42800, rc 0) 00000100:00100000:3.0:1788748534.090470:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14465:x1875638358235648:12345-192.168.203.4@tcp:101:dd.0 Request processed in 241us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748534.090478:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00010000:00010000:3.0:1788748534.382487:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748534.829439:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788748534.829448:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748534.829512:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788748534.829519:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788748534.829759:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14351:1875638377093760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748534.829929:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec4930180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748534.833467:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14351:1875638377093760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748534.849584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.849754:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235776 00000100:00100000:0.0:1788748534.849770:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235776 00000100:00100000:0.0:1788748534.849841:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748534.849853:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358235776:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788748534.849948:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358235776:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 98us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748534.849956:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788748534.853233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.853331:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358235904 00000100:00100000:3.0:1788748534.853344:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358235904 00000100:00100000:3.0:1788748534.853486:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:3.0:1788748534.853500:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358235904:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748534.853554:0:14320:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748534.853855:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358235904:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 357us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748534.853864:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748534.857474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.857631:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358236032 00000100:00100000:2.0:1788748534.857645:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358236032 00000100:00100000:2.0:1788748534.857730:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1788748534.857743:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358236032:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788748534.857841:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857862:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857877:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857896:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857903:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857910:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857935:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857962:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.857968:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748534.858048:0:16300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788748534.858053:0:16300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748534.858079:0:16300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858093:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858100:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858107:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858114:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.858119:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858127:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858141:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:2.0:1788748534.858144:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.858150:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858168:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d54c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858183:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858190:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858196:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858201:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.858204:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858210:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858218:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99cec6646c00) 00010000:00010000:2.0:1788748534.858220:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.858223:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858229:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d553 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858246:0:16300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858252:0:16300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858264:0:16300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858270:0:16300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.858273:0:16300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858280:0:16300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858287:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:2.0:1788748534.858290:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.858292:0:16300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.858298:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d55a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748534.858402:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358236032:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 660us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.858411:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1788748534.862308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.862472:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358236288 00000100:00100000:0.0:1788748534.862485:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358236288 00000100:00100000:0.0:1788748534.862570:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:0.0:1788748534.862583:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+24:14467:x1875638358236288:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748534.862623:0:15949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748534.862654:0:15949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d561 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b49 expref: -99 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.862806:0:15949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.862826:0:15949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.862855:0:15949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748534.862870:0:15949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748534.862994:0:15949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863002:0:15949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863009:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863071:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748534.863077:0:15949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863085:0:15949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863099:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748534.863102:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748534.863108:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863115:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d568 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863178:0:15949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d561 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b49 expref: 26 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863209:0:15949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:0.0:1788748534.863211:0:15949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748534.863216:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d561 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b49 expref: 26 pid: 15949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.863226:0:15949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748534.863290:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+25:14467:x1875638358236288:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 710us (998us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788748534.863297:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1788748534.867919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.868135:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358236416 00000100:00100000:3.0:1788748534.868148:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358236416 00000100:00100000:3.0:1788748534.868236:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1788748534.868248:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+25:14467:x1875638358236416:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748534.868299:0:14320:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748534.868441:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+25:14467:x1875638358236416:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 194us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748534.868449:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788748534.872989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.873378:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358236672 00000100:00100000:3.0:1788748534.873393:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358236672 00000100:00100000:3.0:1788748534.873466:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748534.873478:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+25:14467:x1875638358236672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748534.873529:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748534.873568:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d576 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b50 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748534.874928:0:14319:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1788748534.874942:0:14319:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788748534.875003:0:14319:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788748534.876483:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42c00/0x5b377f42a7a7d57d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.876512:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42c00/0x5b377f42a7a7d57d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.876528:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42c00/0x5b377f42a7a7d57d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.876819:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d576 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b50 expref: 28 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.876846:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42c00/0x5b377f42a7a7d57d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b50 expref: 27 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.876857:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ced1a56000) 00010000:00010000:3.0:1788748534.876860:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748534.876864:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42c00, rc 0) 00000100:00100000:3.0:1788748534.877099:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+27:14467:x1875638358236672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3621us (4120us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788748534.877109:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1788748534.881397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.881499:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358236928 00000100:00100000:2.0:1788748534.881514:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358236928 00000100:00100000:2.0:1788748534.881599:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788748534.881609:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+27:14467:x1875638358236928:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748534.881698:0:14318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748534.881734:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42c00/0x5b377f42a7a7d57d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b50 expref: 27 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881781:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ced1a56000) 00010000:00010000:2.0:1788748534.881795:0:14318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748534.881824:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881840:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881853:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881874:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881881:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881889:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881968:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881976:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881983:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.881989:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.881993:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882007:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882073:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:2.0:1788748534.882077:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.882082:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882088:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7d58b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882097:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882102:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882108:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882113:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748534.882116:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882121:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882127:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc0325c50 (ffff99cec6646c00) 00010000:00010000:2.0:1788748534.882129:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748534.882132:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.882150:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7d592 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0325c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748534.882252:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+26:14467:x1875638358236928:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 643us (868us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748534.882258:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1788748534.885505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.885595:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358237056 00000100:00100000:2.0:1788748534.885607:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358237056 00000100:00100000:2.0:1788748534.885690:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1788748534.885702:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+26:14467:x1875638358237056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748534.885727:0:16300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748534.885756:0:16300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d599 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b57 expref: -99 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885800:0:16300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d5a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885815:0:16300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885828:0:16300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885954:0:16300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d599 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b57 expref: 28 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885978:0:16300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b57 expref: 27 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.885999:0:16300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:2.0:1788748534.886002:0:16300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748534.886006:0:16300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3800, rc 0) 00000100:00100000:2.0:1788748534.886118:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+27:14467:x1875638358237056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 417us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.886124:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748534.889517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.889834:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358237312 00000100:00100000:3.0:1788748534.889863:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358237312 00000100:00100000:3.0:1788748534.889971:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788748534.889983:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+27:14467:x1875638358237312:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748534.890140:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.890160:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.890173:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748534.891521:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788748534.891702:0:14319:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451934685690ns, next at 452934678163ns, rc = 0 00000004:00010000:0.0:1788748534.891855:0:14319:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000075f81d53 reply state 00000000d9269d38 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748534.891870:0:14319:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748534.892041:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+29:14467:x1875638358237312:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2055us (2533us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788748534.892051:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00010000:00010000:3.0:1788748534.894191:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894213:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894222:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894229:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748534.894234:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894241:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894260:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:3.0:1788748534.894264:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748534.894288:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.894294:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42600/0x5b377f42a7a7d5a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748534.895979:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.896266:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358237440 00000100:00100000:3.0:1788748534.896280:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358237440 00000100:00100000:3.0:1788748534.896351:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1788748534.896362:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+28:14467:x1875638358237440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748534.896394:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748534.896419:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b5e expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.896786:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 29 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.896805:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 29 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748534.896830:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:3.0:1788748534.896834:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748534.896839:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b43600, rc 0) 00000100:00100000:3.0:1788748534.896915:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+29:14467:x1875638358237440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 554us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748534.896922:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1788748534.900142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.900274:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358237568 00000100:00100000:0.0:1788748534.900287:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358237568 00000100:00100000:0.0:1788748534.900358:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788748534.900370:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358237568:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788748534.900976:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2348:x1875638358237568:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 604us (843us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788748534.900985:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748534.906639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.906835:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358237824 00000100:00100000:0.0:1788748534.906858:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358237824 00000100:00100000:0.0:1788748534.906935:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748534.906946:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+29:14467:x1875638358237824:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748534.907311:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+30:14467:x1875638358237824:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 365us (684us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788748534.907319:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748534.912172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.912292:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238080 00000100:00100000:0.0:1788748534.912305:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238080 00000100:00100000:0.0:1788748534.912416:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1788748534.912427:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+30:14467:x1875638358238080:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748534.912588:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+30:14467:x1875638358238080:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 162us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748534.912596:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:1.0:1788748534.923676:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.923840:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238208 00000100:00100000:0.0:1788748534.923852:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238208 00000100:00100000:0.0:1788748534.923923:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788748534.923934:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+30:14467:x1875638358238208:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748534.923961:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748534.923986:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b65 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924149:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924166:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924191:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748534.924238:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748534.924259:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924288:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b65 expref: 32 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924308:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b65 expref: 31 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748534.924318:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:0.0:1788748534.924321:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748534.924325:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4e00, rc 0) 00000100:00100000:0.0:1788748534.925611:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+31:14467:x1875638358238208:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1665us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748534.925625:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1788748534.940703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748534.940941:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238336 00000100:00100000:2.0:1788748534.940955:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238336 00000100:00100000:2.0:1788748534.941088:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748534.941101:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2347:x1875638358238336:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748534.941126:0:15006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748534.941154:0:15006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b6c expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748534.941187:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e22f6, blocks: 0x1 00010000:00010000:2.0:1788748534.941220:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788748534.941225:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748534.941236:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 7 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.941259:0:15006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 7 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748534.941273:0:15006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3000, rc 0) 00000100:00100000:2.0:1788748534.941356:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2347:x1875638358238336:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 257us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.941364:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788748534.956779:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748534.960843:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238592 00000100:00100000:3.0:1788748534.960867:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238592 00000100:00100000:2.0:1788748534.961157:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:2.0:1788748534.961172:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+31:14467:x1875638358238592:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788748534.961403:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+31:14467:x1875638358238592:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 234us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748534.961411:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788748534.975675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748534.975765:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238720 00000100:00100000:0.0:1788748534.975779:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238720 00000100:00100000:0.0:1788748534.975858:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788748534.975871:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+31:14467:x1875638358238720:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788748535.029887:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1788748535.029939:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1788748535.029948:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1788748535.029975:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788748535.030300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377093888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788748535.030401:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748535.030689:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377093888 00000100:00100000:1.0:1788748535.030699:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377093888 00000100:00100000:1.0:1788748535.030781:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748535.030794:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377093888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788748535.031004:0:15495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788748535.031009:0:15495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788748535.031011:0:15495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788748535.031045:0:15495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788748534 -> 1788748534 00002000:00010000:1.0:1788748535.031048:0:15495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788748535.031119:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875638377093888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (717us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788748535.031128:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788748535.031342:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788748535.031398:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cf01ee8380/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788748535.031406:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377093888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788748535.032090:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14467:x1875638358238720:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 56215us (56424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748535.032102:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1788748535.034690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748535.034804:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358238848 00000100:00100000:2.0:1788748535.034816:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358238848 00000100:00100000:2.0:1788748535.034901:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748535.034912:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2347:x1875638358238848:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788748535.035102:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2347:x1875638358238848:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 191us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748535.035111:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00080000:3.0:1788748535.035329:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748535.042190:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.042300:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239104 00000100:00100000:0.0:1788748535.042330:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239104 00000100:00100000:0.0:1788748535.042409:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788748535.042422:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14467:x1875638358239104:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748535.042511:0:14319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748535.042562:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4e00/0x5b377f42a7a7d5bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b65 expref: 14 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.042587:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:0.0:1788748535.042593:0:14319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748535.042645:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.042662:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.042675:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748535.042929:0:14319:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000067b60df0 reply state 000000009f03df0e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.042941:0:14319:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748535.043143:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:14467:x1875638358239104:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 722us (968us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788748535.043150:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00010000:00010000:2.0:1788748535.052150:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052173:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052183:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052190:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748535.052196:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052226:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052245:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:2.0:1788748535.052249:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748535.052255:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.052261:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4800/0x5b377f42a7a7d5ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748535.054720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.056795:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239232 00000100:00100000:0.0:1788748535.056816:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239232 00000100:00100000:1.0:1788748535.059328:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788748535.059345:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:14467:x1875638358239232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748535.059369:0:15495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748535.059405:0:15495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b73 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.059463:0:15495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 8 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.059498:0:15495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788748535.059503:0:15495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748535.059510:0:15495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 8 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.059567:0:15495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 8 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.059584:0:15495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 8 pid: 15006 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748535.059600:0:15495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15495:1875638377094016:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748535.059727:0:15495:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceeccd0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748535.063711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.064187:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239360 00000100:00100000:0.0:1788748535.064201:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239360 00010000:00010000:0.0:1788748535.064258:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 9 pid: 15006 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.064336:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788748535.064348:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:2348:x1875638358239360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748535.064370:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748535.064412:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 9 pid: 15006 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.064428:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 9 pid: 15006 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.064477:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.064483:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.064491:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.064503:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.064561:0:14303:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.064579:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14303:1875638377094144:192.168.203.4@tcp:105: 00000100:00100000:0.0:1788748535.064683:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee02db6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788748535.065754:0:15495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b6c expref: 9 pid: 15006 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748535.065777:0:15495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cf01ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15495:1875638377094016:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788748535.065816:0:15495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 8 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.065830:0:15495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8200, rc 0) 00000100:00100000:3.0:1788748535.065897:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+8:14467:x1875638358239232:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 6555us (11193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748535.065906:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788748535.073104:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14303:1875638377094144:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748535.073164:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748535.073245:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358239360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8898us (9547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748535.073258:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788748535.075610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.075833:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239488 00000100:00100000:0.0:1788748535.075846:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239488 00000100:00100000:0.0:1788748535.075959:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748535.075972:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358239488:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788748535.076270:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788748535.076274:0:15006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788748533 00002000:00010000:0.0:1788748535.076277:0:15006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788748532 00002000:00010000:0.0:1788748535.076279:0:15006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788748534 -> 1788748533 00002000:00010000:0.0:1788748535.076281:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788748535.076431:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+8:2348:x1875638358239488:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 460us (1047us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788748535.076450:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788748535.079921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748535.080283:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239616 00000100:00100000:2.0:1788748535.080296:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239616 00000100:00100000:0.0:1788748535.080379:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788748535.080405:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+8:2348:x1875638358239616:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788748535.080734:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.080759:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 8 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.080768:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.080790:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748535.080796:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.080845:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 8 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.080863:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 8 pid: 15495 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.080881:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15006:1875638377094272:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748535.080999:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee02db6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748535.083997:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15006:1875638377094272:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748535.084088:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.087363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748535.087727:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358239744 00000100:00100000:3.0:1788748535.087742:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358239744 00010000:00010000:3.0:1788748535.087801:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748535.087908:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1788748535.087934:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:2348:x1875638358239744:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748535.087955:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748535.087986:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.088003:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.088078:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d5d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b73 expref: 9 pid: 15495 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.088102:0:14304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748535.088106:0:14304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748535.088113:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.088124:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.088155:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748535.088243:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+8:2348:x1875638358239744:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 312us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748535.088250:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:0.0:1788748535.089527:0:15006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089556:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089596:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089626:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089635:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089649:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.089654:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089665:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089686:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.089695:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d5d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.089825:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358239616:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 9418us (9911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748535.089836:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788748535.093258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748535.093364:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240000 00000100:00100000:2.0:1788748535.093377:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240000 00000100:00100000:2.0:1788748535.093739:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788748535.093754:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:14467:x1875638358240000:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748535.093871:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.093892:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.093905:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.094702:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.094732:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.094742:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.094788:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.094805:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 15 pid: 14320 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748535.094823:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ceecdddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875638377094400:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748535.094941:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed615e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748535.099702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748535.100453:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240128 00000100:00100000:1.0:1788748535.100472:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240128 00010000:00010000:1.0:1788748535.100545:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 16 pid: 14320 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748535.100681:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788748535.100695:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+16:2348:x1875638358240128:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748535.100714:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748535.100723:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 16 pid: 14320 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.100758:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 16 pid: 14320 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.100791:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:1.0:1788748535.100798:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.100810:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.100819:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.100847:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748535.100942:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+16:2348:x1875638358240128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 249us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748535.100952:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:0.0:1788748535.100987:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b43600/0x5b377f42a7a7d5ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b5e expref: 15 pid: 14320 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.101039:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ceecdddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875638377094400:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748535.101083:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.101094:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.101100:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748535.101368:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788748535.101580:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788748535.101623:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788748535.101721:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14318:1875638377094528:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788748535.101818:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748535.101868:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdb29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748535.102114:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377094528 00000100:00100000:2.0:1788748535.102123:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377094528 00000100:00100000:2.0:1788748535.102185:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748535.102195:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875638377094528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788748535.102299:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875638377094528:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748535.102308:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748535.102326:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14318:1875638377094528:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788748535.103348:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788748535.103452:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14318:1875638377094656:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788748535.103505:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748535.103544:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec8a0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748535.103788:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377094656 00000100:00100000:2.0:1788748535.103796:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377094656 00000100:00100000:2.0:1788748535.103839:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748535.103848:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875638377094656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788748535.104135:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14318:x1875638377094656:12345-0@lo:1000:mdt00_000.0 Request processed in 287us (629us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788748535.104144:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748535.104237:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14318:1875638377094656:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788748535.104281:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104294:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104315:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104321:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748535.104327:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104336:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104356:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:0.0:1788748535.104359:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748535.104366:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104373:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7d5e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104410:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.104417:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.105910:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.105922:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748535.105927:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.105957:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.105977:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748535.105980:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748535.105991:0:14318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.106004:0:14318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.106030:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.106136:0:14318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.106153:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875638377094784:192.168.203.4@tcp:105: 00000100:00100000:0.0:1788748535.106261:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec8a0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748535.109874:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875638377094784:192.168.203.4@tcp:105: 00010000:00010000:0.0:1788748535.109918:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.109930:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7d53e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.109969:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110040:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110056:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110084:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110096:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110112:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110119:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748535.110124:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110132:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110145:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748535.110149:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748535.110153:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110159:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7d5ed lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110170:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110182:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110189:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110195:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748535.110198:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110205:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110213:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:0.0:1788748535.110216:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748535.110219:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.110224:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7d5df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.110532:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:14467:x1875638358240000:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 16780us (17284us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788748535.110544:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000020:00080000:0.0:1788748535.110552:0:14318:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788748535.110643:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788748535.110649:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748535.110692:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788748535.110707:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788748535.117785:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.117891:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240256 00000100:00100000:0.0:1788748535.117906:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240256 00000100:00100000:0.0:1788748535.117987:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788748535.118000:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecc8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:14465:x1875638358240256:12345-192.168.203.4@tcp:49:dd.0 00000100:00100000:0.0:1788748535.118287:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecc8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:14465:x1875638358240256:12345-192.168.203.4@tcp:49:dd.0 Request processed in 288us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748535.118296:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748535.120644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.120740:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240512 00000100:00100000:0.0:1788748535.120753:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240512 00000100:00100000:0.0:1788748535.120823:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748535.120836:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+18:14467:x1875638358240512:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748535.122159:0:14321:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748535.122293:0:14321:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788748535.122362:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122385:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122399:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122411:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122418:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122425:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.122467:0:14321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748535.122570:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748535.122580:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.122590:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748535.122595:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.122607:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+20:14467:x1875638358240512:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1768us (1970us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1788748535.122608:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.122629:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:3.0:1788748535.122634:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1788748535.122635:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00010000:00010000:3.0:1788748535.122641:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788748535.122645:0:14321:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748535.122651:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4c00/0x5b377f42a7a7d5f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.122669:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748535.122671:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748535.122674:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748535.360918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748535.360973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748535.363066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748535.364539:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240640 00000100:00100000:2.0:1788748535.364559:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240640 00000100:00100000:2.0:1788748535.364630:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240768 00000100:00100000:2.0:1788748535.364634:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240768 00000100:00100000:2.0:1788748535.364652:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358240896 00000100:00100000:2.0:1788748535.364654:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358240896 00000100:00100000:2.0:1788748535.364689:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748535.364701:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+9:2350:x1875638358240640:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:2.0:1788748535.364767:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9e22f5, atime: 0x6a9e22f4, ctime: 0x6a9e22f5, blocks: 0x1 00010000:00010000:2.0:1788748535.364778:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.364801:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788748535.364806:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748535.364815:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.364832:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.407356:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788748535.509356:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1788748535.509411:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1788748535.509427:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1788748535.509443:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1788748535.510327:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1788748535.510337:0:15011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788748533 -> 1788748534 00002000:00010000:0.0:1788748535.510340:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788748535.510359:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510375:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510463:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510472:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.510477:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510488:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510515:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.510524:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9928f9/0x5b377f42a7a7d5fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.511339:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2350:x1875638358240640:12345-192.168.203.4@tcp:4:dd.0 Request processed in 146632us (150425us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788748535.511352:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748535.511412:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748535.511428:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2350:x1875638358240768:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788748535.511491:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9e22f6, atime: 0x6a9e22f4, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1788748535.511500:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.511516:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788748535.511522:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.511773:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.511795:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748535.583687:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1788748535.588077:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1788748535.588088:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1788748535.588105:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588118:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588151:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588158:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.588163:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588171:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588190:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588197:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d602 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.588297:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+6:2350:x1875638358240768:12345-192.168.203.4@tcp:4:dd.0 Request processed in 76871us (227318us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788748535.588307:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748535.588339:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1788748535.588349:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358240896:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788748535.588388:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9e22f6, atime: 0x6a9e22f4, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1788748535.588394:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588416:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788748535.588420:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.588427:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.588439:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748535.705789:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788748535.705896:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788748535.705901:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788748535.705916:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.705930:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.705939:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.705946:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.705950:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.705958:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.705995:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.706003:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.706322:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2349:x1875638358240896:12345-192.168.203.4@tcp:4:dd.0 Request processed in 117972us (343310us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788748535.706333:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788748535.720405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.720505:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241024 00000100:00100000:0.0:1788748535.720520:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241024 00000100:00100000:0.0:1788748535.720611:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788748535.720622:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358241024:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788748535.720673:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9e22f6, atime: 0x6a9e22f4, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788748535.720684:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.720700:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788748535.720705:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.720711:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.720725:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748535.721702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.723349:0:15011:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788748535.723366:0:15011:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788748535.723953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748535.725258:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241152 00000100:00100000:1.0:1788748535.725276:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241152 00000100:00100000:1.0:1788748535.725372:0:15011:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748535.725399:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241280 00000100:00100000:1.0:1788748535.725404:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241280 00000100:00100000:3.0:1788748535.729989:0:16555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748535.730005:0:16555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+8:2348:x1875638358241152:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:3.0:1788748535.730078:0:16555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.730102:0:16555:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748535.730106:0:16555:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748535.730113:0:16555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.730129:0:16555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748535.732965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.734587:0:15011:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788748535.734602:0:15011:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788748535.734748:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241536 00000100:00100000:0.0:1788748535.734758:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241536 00000100:00100000:0.0:1788748535.735205:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748535.735216:0:16556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+10:2347:x1875638358241280:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:0.0:1788748535.735253:0:16556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.735271:0:16556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.735276:0:16556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.735283:0:16556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.735298:0:16556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748535.736219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748535.736319:0:15011:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788748535.736327:0:15011:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1788748535.737556:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241408 00000100:00100000:2.0:1788748535.737572:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241408 00000100:00100000:0.0:1788748535.744482:0:16557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788748535.744499:0:16557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:2348:x1875638358241536:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:0.0:1788748535.744622:0:16557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.744660:0:16557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.744665:0:16557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.744671:0:16557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.744686:0:16557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748535.849823:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1788748535.849994:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:0.0:1788748535.850003:0:15010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788748534 -> 1788748535 00002000:00010000:0.0:1788748535.850007:0:15010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788748535 00002000:00010000:0.0:1788748535.850009:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1788748535.850075:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850092:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850103:0:15010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850113:0:15010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.850120:0:15010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850131:0:15010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850185:0:15010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.850195:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.851095:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+16:2348:x1875638358241024:12345-192.168.203.4@tcp:4:dd.0 Request processed in 130395us (130623us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788748535.851109:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788748535.851158:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748535.851173:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:2348:x1875638358241408:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:0.0:1788748535.851223:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.851251:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.851256:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748535.851263:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.852192:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748535.856972:0:16555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788748535.856996:0:16555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857010:0:16555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857039:0:16555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857046:0:16555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748535.857052:0:16555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857078:0:16555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857103:0:16555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748535.857121:0:16555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d617 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748535.857218:0:16555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:2348:x1875638358241152:12345-192.168.203.4@tcp:4:dd.0 Request processed in 127213us (135517us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788748535.857229:0:16555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00002000:00010000:1.0:1788748535.904168:0:16556:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788748535.904187:0:16556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904201:0:16556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904210:0:16556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904216:0:16556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748535.904220:0:16556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904229:0:16556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904248:0:16556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748535.904255:0:16556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5cfd415/0x5b377f42a7a7d61e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748535.904334:0:16556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:2347:x1875638358241280:12345-192.168.203.4@tcp:4:dd.0 Request processed in 169116us (180386us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788748535.904343:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00010000:00010000:0.0:1788748535.904897:0:16557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904920:0:16557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904928:0:16557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904934:0:16557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748535.904937:0:16557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904944:0:16557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904957:0:16557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748535.904964:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f07c50/0x5b377f42a7a7d625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748535.905006:0:16557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+13:2348:x1875638358241536:12345-192.168.203.4@tcp:4:dd.0 Request processed in 160512us (172050us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788748535.905045:0:16557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000001:00080000:2.0:1788748535.905232:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:2.0:1788748535.905246:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1788748535.938636:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788748535.938657:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938671:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938680:0:15010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938688:0:15010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748535.938693:0:15010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938701:0:15010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938719:0:15010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748535.938726:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058a97100/0x5b377f42a7a7d62c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748535.938826:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+7:2348:x1875638358241408:12345-192.168.203.4@tcp:4:dd.0 Request processed in 87654us (202605us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788748535.938851:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000001:00080000:3.0:1788748535.938928:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000100:00100000:1.0:1788748536.045260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748536.045284:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377094912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748536.045350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748536.045513:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377094912 00000100:00100000:0.0:1788748536.045522:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377094912 00000100:00100000:0.0:1788748536.045590:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748536.045600:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377094912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748536.045645:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748536.045754:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377094912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748536.045761:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788748536.045857:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748536.045960:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377094912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748536.429728:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748536.557737:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748536.557818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748536.558187:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095040 00000100:00100000:1.0:1788748536.558195:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095040 00000100:00100000:1.0:1788748536.558248:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748536.558257:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377095040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748536.558280:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1788748536.558336:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377095040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748536.558342:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748536.558419:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788748536.558425:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cf01ee8380, transno 8589934595 00000004:00080000:2.0:1788748536.558441:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788748536.558467:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748536.558715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377095168:0@lo:400:kworker.0 00000100:00100000:3.0:1788748536.558752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748536.558796:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748536.558803:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377095552:0@lo:400:kworker.0 00000100:00100000:3.0:1788748536.558829:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748536.558899:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377095424:0@lo:400:kworker.0 00000100:00100000:3.0:1788748536.559211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748536.559231:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748536.559237:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377095296:0@lo:400:kworker.0 00000100:00100000:3.0:1788748536.559259:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748536.559338:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095552 00000100:00100000:2.0:1788748536.559345:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095552 00000100:00100000:2.0:1788748536.559386:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095424 00000100:00100000:2.0:1788748536.559388:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095424 00000100:00100000:2.0:1788748536.559405:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095296 00000100:00100000:2.0:1788748536.559408:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095296 00000100:00100000:2.0:1788748536.559421:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748536.559428:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377095552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748536.559472:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377095552:12345-0@lo:400:kworker.0 Request processed in 44us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748536.559478:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748536.559493:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748536.559498:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377095424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748536.559528:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875638377095424:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748536.559534:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748536.559545:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748536.559565:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377095296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748536.559595:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875638377095296:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748536.559600:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748536.559630:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875638377095296:0@lo:400:kworker.0 00000100:00100000:2.0:1788748536.559640:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875638377095424:0@lo:400:kworker.0 00000100:00100000:2.0:1788748536.559667:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377095552:0@lo:400:kworker.0 00000100:00100000:0.0:1788748536.559739:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095168 00000100:00100000:0.0:1788748536.559744:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095168 00000100:00100000:0.0:1788748536.559786:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788748536.559794:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748536.559835:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377095168:12345-0@lo:400:kworker.0 Request processed in 43us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748536.559841:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788748536.560199:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377095168:0@lo:400:kworker.0 00000100:00080000:3.0:1788748536.560743:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788748537.453254:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748537.611786:0:16594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1788748538.411455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411502:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748538.411674:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241920 00000100:00100000:2.0:1788748538.411684:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241920 00000100:00100000:2.0:1788748538.411747:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242432 00000100:00100000:2.0:1788748538.411751:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242432 00000100:00100000:2.0:1788748538.411766:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242048 00000100:00100000:2.0:1788748538.411769:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242048 00000100:00100000:2.0:1788748538.411780:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242304 00000100:00100000:2.0:1788748538.411782:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242304 00000100:00100000:2.0:1788748538.411796:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788748538.411805:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358241920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748538.411988:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242176 00000100:00100000:1.0:1788748538.411993:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242176 00000100:00100000:1.0:1788748538.412076:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241792 00000100:00100000:1.0:1788748538.412080:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241792 00000100:00100000:1.0:1788748538.412104:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1788748538.412111:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2347:x1875638358242176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748538.412193:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2347:x1875638358242176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748538.412201:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1788748538.412218:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788748538.412225:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+20:2347:x1875638358241792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748538.412253:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+20:2347:x1875638358241792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748538.412259:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1788748538.412505:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358241920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 699us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748538.412512:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788748538.412529:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788748538.412537:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2347:x1875638358242432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748538.412561:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2347:x1875638358242432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748538.412566:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788748538.412578:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748538.412583:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358242048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748538.412612:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358242048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748538.412618:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788748538.412629:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788748538.412636:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2347:x1875638358242304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748538.412657:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2347:x1875638358242304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748538.412662:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:3.0:1788748538.412982:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748538.412987:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748538.412990:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748538.413623:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358241664 00000100:00100000:0.0:1788748538.413631:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358241664 00000100:00100000:0.0:1788748538.413686:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:0.0:1788748538.413695:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2347:x1875638358241664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748538.413767:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2347:x1875638358241664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748538.413775:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00010000:00010000:2.0:1788748538.477469:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748539.504218:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29184 lines, 29184 kept, 0 dropped, 0 bad.